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1.  Introduction  and  Summary.  We  shall  start  off  by  considering  two  examples 
of  stochastically  monotone  (SM)  sequences  exhibiting  rather  contrasting  sample 
path  behaviour.  Let  {Fn)  be  a  sequence  of  i.i.d.  random  variables  with  mean  0 
and  variance  1,  and  Sn  =  F-|  +...£  .  It  is  well-known  that  {Sn//n  }  converoes 
in  distribution  to  the  standard  normal  distribution  N(0,1)  and  P(lim  inf  S  //n  = 

n-+«. 


=  P(lim  sup  S  //n  =  <*>)  =  ].  Consider  further  a  supercritical  Gal ton-Watson 

n-x»  y 

process  { }  defined  as  Zn+^  =  J  Fp  where  {fn  .}  are  i.i.d.  conditional  on  Zn 

^  ^  «x> 

and  P(F  .  =  k)  =  p.  ,  k  =  0,1,...  If  m  =  £  kp,  c  (1,°°)  it  is  known  (see 
n,i  k  k=0  k 


e.g.  [3])  that  there  exist  some  norming  constants  (c  }  with  lim  c  +1/c  =  m 


such  that  rZ  /c  }  converges  a.s.  to  a  random  variable  W  whose  distribution 
n  n 

function  is  continuous  and  strictly  increasing  on  (0,°°).  Both  cases  are  instances 
of  SM  Markov  chains  with  stationary  transition  probabilities  f Xn >  for  which 
there  exist  norming  constants  {a  }  such  that  {a  X  }  converges  in  distribution 
to  a  non-degenerate  limit  K.  We  shall  see  that  under  rather  general  conditions. 


the  growth  rate  of  the  norming  constants  {anl  determines  the  limit  pattern  of 

;a  X  1  and  characteri zes  its  limit  distribution:  if  lim  a  ,,/a  =  1  then 

n  n  n+r  n 


P(lim  inf  a  X  inf  supp  F)  =  P(lim  sup  a  X  >  sup  supp  F)  =  1,  whereas  if 
n  *•>  n-»o 

lim  a  ,,/a  t  1  then  :a  X  }  converges  a.s.,  the  supp  F  is  either  the  real  line 
n+1  n  n  n 


n 

or  one  of  its  half-lines,  F  is  strictly  increasing  on  supp  F,  and  continuous 
except  maybe  for  x  =  0. 

A  transition  probability  function  P  is  said  to  be  SM  if  P(x,(~’,y])  is 
non-increasing  in  x  for  every  fixed  y.  A  non-homoneneous  Markov  process 


uv.-lal 


t 

□ 


:od©8 

•'or 


2 


{ X ( t ) ;  t  c  [0,°°)}  (or  chain  (Xn:  n  >  0})  is  said  to  be  SM  if  its  transition 
probability  functions  are  SM.  If  { Xp }  is  a  discrete  time  non-homogeneous 
Markov  chain,  the  stochastic  monotonicity  of  the  one-step  transition  proba¬ 
bilities  f }  suffices  for  the  stochastic  monotonicity  of  { }  (see  [12] 

Theorem  1).  The  term  "stochastic  monotonicity"  was  coined  in  [12]  and  has  made 
the  object  of  intensive  study  in  a  number  of  articles  and  monographs  (see  [10], 
[14],  [15],  [17]  and  [26]).  Two  recent  papers  ([7]  and  [2])  have  dealt  with 
SM  from  the  point  of  view  of  the  limit  behaviour.  In  [7]  criteria  for 
convergence  is  probability  or  a.s.  convergence  have  been  derived  for  chains 
converging  in  distribution  to  non-degenerate  limits.  In  the  case  when  F  is 
continuous  such  criteria  were  shown  to  be  necessary  and  sufficient.  The 
object  of  investigation  in  [2]  was  the  self-normalized  process  { Fp ( X  ) } , 
where  Fn  is  the  distribution  function  of  Xn>  under  the  assumption 

(1.1)  sup  P(Xn  =  x)  --  0 

Under  (1.1),  (Fn(Xn)}  converges  in  distribution  to  the  uniform  distribution 
on  [0,1].  Among  other  properties  of  interest,  [2]  contains  a  detailed  descrip¬ 
tion  of  the  case  when  a.s.  convergence  fails.  It  turns  out  that  the  sample 

l  i 

space  T:  can  be  parti  tioned  into  some  sets  y  y  •  •  •  and  s’  -j ,  , . . .  If 

i 

W  =  F  (XI  then  for  r  s’,  lim  W  (.,>)  exists,  whereas  if  -.i  .  f. .  then  there 
n  n  n  in  l 

n 

exist  two  numbers  a.  and  b.  with  a.  <  b-  such  that  lim  inf  W  (•. )  -  a.  and 

‘  '  1  n-*‘ 

lim  sup  W  (.,>)  =  b..  A  pictorial  description  of  this  sample  path  behaviour 
n-*» 


is  given  in  Fig.  1.1  below. 


m 


Figure  1 . 1 

i 

When  {W  }  converges  a.s.  the  sets  {^}  are  absent,  whereas  in  the  situation 

l 

described  by  the  example  of  {Sn/fri  },  {^.}  and  all  but  one  of  {H  }  are  absent. 

If  IX  }  converges  in  distribution  to  a  limit  F  admitting  jump  points, 
convergence  a.s.  or  otherwise  may  occur  irrespective  of  the  properties  of  {W  } 
Indeed,  the  strong  law  of  large  numbers  for  {S  /n)  is  not  prevented  by 

P(lim  inf  Wn  =  0)  =  P(lim  sup  W  =  1)  =  1.  It  would  be  therefore  of  interest 

n  X"  n->°o 

to  study  the  limit  behaviour  of  { Xn }  when  its  limit  distribution  is  not  neces¬ 
sarily  a  smooth  one  and  even  when  convergence  in  distribution  does  not  hold. 

We  shall  give  here  a  new  approach  to  SM  processes  which  does  not  require  con¬ 
vergence  in  distribution  or  condition  (1.1)  and  enables  one  to  study  several 
aspects  of  the  limit  behaviour.  Our  method  is  based  on  the  existence  of  some 

random  variables  fW  1  such  that  E(W  IX  )  =  lim  P(X  .  J  |X  )  a.s.  for  any 

q  <*'  k_  nk  nk  n' 


subsequence  in,}  and  left-unbounded  intervals  J  1  with  lim  P(X  <  J  )  =  q, 

nk  nk 


4 


q  t  (0,1)  and  n  =  0,1,...  The  variables  {W^l  may  admit  at  most  three  different 
values  with  positive  probability.  If  P(W^  =  0)  =  1-P(W  =1)  will  be  said 
to  be  of  type  I,  and  of  type  II  otherwise.  Type  I  variables  are  of  the  kind 
studied  in  [7]  in  connection  with  almost  sure  convergence,  whereas  type  II 
variables  characterize  some  features  similar  to  those  descrited  in  [2]  for 
the  case  when  almost  sure  convergence  fails.  In  Section  2,  in  addition  to 
describing  {W^},  we  give  some  results  relating  limit  properties  of  subsequences 
of  TXT  as  well  as  a  simple  criterion  for  a  sequence  to  be  mixing.  In  Section  3 
we  study  sequences  converging  in  distribution  where  we  shall  find  it  convenient 
to  introduce  two  types  of  limit  points  and  characterize  the  limit  behaviour  in 
each  case.  The  object  of  Section  4  is  the  limit  behaviour  of  suitably  normed 
and  centered  Markov  chains  and  processes  with  stationary  transition  probabilities. 
In  Section  5  criteria  for  a.s.  convergence  are  derived  under  some  assumption 
of  tightness.  Finally,  Section  6  contains  some  applications  to  branching 
processes  and  diffusions. 

The  main  ingredient  of  the  approach  is  the  identification  of  the  sequence 
of  conditional  limit  distributions  as  a  martingale,  which  leads  to  the  limit 
variables  iW^l.  A  reader  interested  in  the  applications  of  Section  6  may  skip 
most  of  the  sections  and  choose  to  read  only  part  of  Section  2  including 
Theorem  2.1  and  the  results  referrred  to  in  the  arguments  of  Section  6. 

2.  The  general  case.  Let  S  _  R  be  the  state-space  of  -X  •,  (  ,f  ,P)  its  under¬ 
lying  probability  space  with  -  =  S  *  S  ■...,  and  m  =  (..  q  ,  ^  )  the 

generic  element  of  ...  We  shall  agree  to  write  A  =  B  a.s.  if  1.  =  1D  a.s.  and 

1 im  1^  =  1^  a.s.,  1  being  the  indicator  function  of  a  set.  Similarly,  we 
n  n 

shall  say  that  (A^-  converges  a.s.  if  (1^  1  does  so.  Further  A  3  denotes  the 

n 

difference  of  the  sets  A  and  B  and  AAB  is  the  symmetric  difference  of  A  and  B. 


5 


We  shall  say  that  {X  }  converges  weakly  to  a  limit  F  if  1 i m  F  (x)  =  F(x)  for 

'  n  "',  - 

any  continuity  point  x  of  F,  the  case  F(-)  1  and/or  F(— ■)  '•  0  beinn  not 

excluded.  If  F(-°°)  =  0  and  F(«)  =  1  we  shall  say  that  { Xn >  convernes  in  distri¬ 
bution  to  F. 

Let  q  be  a  number  with  0  <  q  <  1  and  assume  that  there  exist  a  subsequence 

{n,  }  of  the  non-negative  integers  and  some  intervals  {J  }  such  that 
k  nk 

lim  P ( X  ?  J  )  =  q,  where  J  =  (-°°,x  ]  or  (-°°,x  )  for  some  {x  }.  Consider 

k-»  nk  nk  nk  nk  nk  nk 

further  the  quantities  {P(X  c  0  IX  =  x)}  for  x  e  supp  F  and  n  >  n.  .  By 

n^  n^ 1  n  n  k 

stochastic  monotonicity  P ( X^  t-  J  |X  =  x)  is  non-increasi no  in  x,  and  by  the 

nk  nk 

well-known  weak  compactness  principle  (see  e.g.  [22]  p.  181)  one  can  extnct  a 

subsequence  of  {n^},  say  {n£}t  such  that  G^(q)  =  lim  P(Xn,  c  Jp , | Xp  =  x) 

K  ’  k-*«>  k  1  k 

exists  for  all  x  <-  supp  F  .  The  process  of  extractina  subsequences  may  be 

carried  out  by  the  well-known  diagonal  procedure  to  produce  a  subsequence 

(n£}  of  in’]  such  that  G^(q)  =  lim  P ( X  *  •  J  *|X  =  x)  exists  for  all 

k  K  x  k-  nk  nk  n 

x  ■  supp  F^  and  n  =  0,1 , . . . 

Lemma  2.1.  There  exists  a  random  variable  W  such  that  lim  (q)  =  W 

n  n 

a.s.,  E(W  )  =  q  and  E(W  | XR)  =  G^n ^ ( q )  a.s.  for  n  =  0,1,... 

^  ^  n 

Proof.  Applying  the  Chapman-Kolmoqorov  formula  to  P(X  +  .  J  *'X  =  x) 

nk  '  k 

and  then  taking  the  limit  as  k--’  yields 


G^(q)  =  j  Gyn  +  1  ^  (q )  Pn  +  1(x,dy)  n=0,l,... 


(2.1) 
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It  is  easy  to  check  that  the  property  (2.1)  defining  a  so-called  space-time 
harmonic  function  G^(q)  leads  to 

(2.2)  E(c4n+1,(q)|X  )  =  Gjn)(q)  a.s. 

Vl  n  n 


The  Markov  property  in  conjunction  with  (2.2)  implies  that  (G^n^(q)}  is  a 

n 

martingale.  Because  {G^(q)l  are  bounded,  lim  Gyn^(q)  =  W  a.s.  exists. 

n-K»  n  ^ 

The  total  probability  formula  yields  E(Gyn4q))=  E(W  )  =  q  and  by  the  closure 

A  Q 

n  M 

property  for  bounded  martingales  we  conclude  that  E(W  |X  )  =  GyP^(q)  a.s.  for 

q  n  *n 


o=0,l ,2,. . . 


Remark  2.1.  The  functions  (G^(q)}  and  therefore  the  limit  variables  {W  } 

x  q 

seem  to  depend  on  the  choice  of  the  subsequence  (n*)  extracted  from  {n^}  at  this 

stage  in  the  proof.  It  will  turn  out  that  G^(q)  are  independent  of  the  choice 

of  {n*}  and  even  that  G^(q)  =  lim  P(X  <  x  |X  =  x)  whenever 
k  x  ,  n,-  n,  1  n  ' 

k-“>"  k  k 

lim  P(X  <  x  )  =  q  for  any  ( n .  }  (which  may  even  be  the  set  of  non-negative 
k-~  nk  “  nk  K 

integers).  The  variables  (W^)  will  turn  out  to  characterize  the  limit 
behaviour  of  { X  } . 


Proposition  2.1.  Let  z  be  a  continuity  point  of  the  distribution  function 
of  W  .  Then 

q 


(a)  1  im  <  X  ■-  I  ;■  =  {W  '•  z )  a.s. 

n  n  q 

no¬ 


where  I  =  (-"'.z  )  or  (-<*>, znl  for  some  real  numbers  ;zn'-. 


(b)  either  {W  =  1}  =  {W 
q  q 


2}  a .s.  or  ■ W  =  0)  =  {W 

q  q 


z  a  .  s . 


Proof.  According  to  Lemma  2.1  IGy  '(q)}  converges  a.s.  to  W  .  This 

*n  q 

implies  that  for  any  continuity  point  z  of  F 


(2.3) 


iW  <  z}  =  1 i m  {Gy  (q)  <  zl  a.s, 
n-x»  n 


Stochastic  monotonicity  and  (2.3)  ensure  the  existence  of  some  left-unbounded 

intervals  tl  }  such  that  lim  (X  r  I  }  =  {W  '•  z}  a.s.  and  (a)  is  proved, 
n  „  n  n  q 

n  «o  ^ 

To  prove  (b)  notice  first  that  two  cases  may  arise:  (i)  Pi'W  >  z)  <_  q 
or  (ii)  P(W  >  z)  >  q.  We  assume  (i)  and  claim  that  G^(q)  -  P(W  >  z  |  X  )  a.s 

q  n  q  n 

Indeed,  by  the  proven  part  (a)  above  P(W„  •>  z  ’  X  )  =  lim  P(X  IX)  a.s. 

J  K  K  q  ■  n  m  m  n 

Assume  by  way  of  contradiction  that  G^(q)  •-  P(w  z  X^)  on  a  set  A  of 

n 

positive  probability.  Since  {I  }  are  left-unbounded  intervals,  this  may  happen 

only  if  >  xn*  for  k  large  enough.  It  follows  that  G^{q)  P(W  z:X  )  a.s 
nk  nk  n  q  n 

with  strict  inequality  on  A.  Taking  expectations  gives  q  P(Wq  •  z),  a 

contradiction  that  proves  that  GyP^(q)  >  P(W  •  z!X  )  a.s.  Combining  the 

n  “  q  n 

latter  inequality  with  the  Markov  property  and  the  martingale  convergence 
r.heorem  yields  W  =  1  for  almost  all  „  .  '  z- .  If  (ii)  holds  one  nets 

G ln  ^ ( a )  ■  P(W  -  z I X  )  a.s.  and  a  similar  reasoning  leads  to  W  -  0  for  almost 

X  '  '  N  q  n  ’  0 


all  •  •  W  z  1 . 

q 

Proposition  2.1(b)  shows  that  may  take  at  most  three  distinct  values 
with  positive  probability,  two  of  them  being  0  and  1.  We  shall  say  that  W 

q 

is  of  type  I  if  P(W  -  0)  -  1  - P ( W  =  1),  and  of  tvpe  II  otherwise.  For  W  of 

q  q  q 
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type  II  the  possible  values  are  0,  k^  and  1  where  0  *  <  1 .  Clearly  E(W^)  =  q 

implies  min(P(W^  =  0),  P(W  =1))  >0  for  q  <  (0,1)  in  case  I,  whereas  in 
case  II  P(Wq  =  0)  =  0  and/or  P(W^  =  1)  =  0  is  a  possibility,  but  P(W^  =  k  ) '-0 

holds  anyway. 

Lemma  2.2  (a)  If  W  is  of  type  I  then  there  exists  a  sequence  of 

left-unbounded  intervals  {I  ;  such  that  1 im  tX  -  I  }  =  f W  =1}  a.s.  and 

n  „  n  n  q 

n^> 

1 im  P ( X  ,  I  )  =  q. 
n  «■ 

(b)  If  there  exists  a  subsequence  f kn >  of  positive  integers  and  some 

left-unbounded  intervals  {q  }  such  that  lim  fXk  «:  1^  }  a.s.  exists,  then  W 

n  n  ko  Kn  Kn  ^ 

is  of  type  I  with  q  =  lim  (X  r  I,  ) . 

n  i  k 

n  k  n 

Proof  If  is  of  type  I  then  P(W^  =  1)  =  q  and  {W^  >  z)  =  {W  =  1}  for 

any  z  with  0  z  1  ,  in  which  case  Proposition  2.1  (a)  implies  that 

lim  X  I  -  ;W  =1-  a.s.  for  some  left-unbounded  intervals  {I  }.  This 
n  n  n  P  n 

necessarily  entails  lim  P(X  •  I  )  =  P(W  =  1)  =  q,  and  (a)  is  proved. 

n  ^ 

Assume  now  that  condition  (b)  is  in  force  and  notice  that 

Pi' A  X„  )  -  lim  P(X,  I.  JX  )  a.s.  where  A  =  lim  -rX,  .  I,  •  a.s.  Further, 
n  k  k  1  nr  k  k 

n  *■  n  n  n  -  •  n  n 

a "  ’o  the  proof  of  Proposition  2.1  (a),  one  can  invoke  the  martingale  conver¬ 
ger,  e  tneore;  and  stochastic  monotonicity  to  deduce  tnat  lim  P(A  X  )  -  a.s. 

m-  • 

'plier  the  existence  of  some  left-unbounded  intervals  <1  >  such  that 


1  :  ■  X 


A  a.s.  To  complete  the  proof  we  shall  show  that  1.  =  W  a.s. 

a  q 


whero  w 


(q)  <i.s.  and  q  =  P( A).  *rdeed,  rccal  1  zhat 


n  *•'  n 


9 


Gym^(q)  -  EiW  ; X  }  -  1 im  P(X  *  .  J  *|X  )  a.s.  where  lim  P(X  .  .  J  .)  :  q. 
X_  u  '  o1  m  ,  n£  n*1  nr  ,  nT  n t 


nk  nk 


Since  ,  I  are  left-unbounded  intervals,  it  is  easy  to  see  that 
n 

lim  P(!X  *  r  J  *}  tx  +  -  I  *})  =  0.  Thus,  if  necessary  by  takinq  a  further 
k~.  nk  nk  nk  nk 

’ * .ttj  .ecuence,  one  can  arrange  to  have  }  P(  {X  *  •  J  *  { X  I  k  - )  «•.  3.v 

k*  Pi  pi  n .  n , 

=  1  k  K  k  k 

trie  Borel -Cantel  1  i  lemma  P(;X  +  t  J  *}  t  -'X  *  I  i.o.)  =  0,  and  this  yields 

n*  n£  n*  n* 


A  »  Inn  -  X  .  J  .  a.s.  Thus  E(W  X  )  =  P ( A ! a  )  a.s.  for  all  n,  which  implies 
.  nf  nf  q1  n  n  K 

k  -  ■  k  k 


q  A 


1 .  a.s.  and  proves  ( b) . 


Lemma_2.3.  Suppose  that  is  of  type  II  and  write  =  P(W^  =  1)  and 

q0  =  1  -  P(W  =0).  Then 
V  q 

(a)  If  P(W  =1)  -0  and/or  P(W  =  0)  0,  then  W  and/or  W  are  of 

d  m  d|  Q2 


type  I ,  ;  W  -•  1-  -  •'  W 


a.s.  and  { W  -01  =  •; W  =  1 }  a . s . 

q  q? 


(b)  There  is  no  o'  in  (q  ,q„)  with  w  ,  of  type  I. 


’roof.  According  to  Proposition  2.1(a)  for  z  such  that  k  '  z  ■  1  in 


case  that  P(X  =  1)  >  0  or  0 


k  in  case  that  P(W  =  0)  :•  0,  we  get  that 


there  n x. ist  some  left-unbounded  intervals  {I  or  <I  M  with  inn  X  i  - 

n  n  ^  n  n 

n 

'  Vv  ‘  1  <r  1 1rr-  <  J,’  ’  =  •  W  >  0-  a.s.  respectively,  and  Lem: '.a  2.2(b) 

n  •  q 

c o " : p  1  e t e s  t h r  p roof  of  (a) . 

To  grove  ( b )  assume  the  contrary  and  choose  q'  .  (q,  ,q.,)  such  that  W 


i  y  . 


.im  two  cases  may  occur:  ( i  ;  c.  •  q1  or  ( i  i  ) 


c  o  .  since 


.  "it:'  'if  ’  r:  /  ,  i  i  i"  pi  i  es  I  -q.,  f1  ( 


,  yj  r.  P  v’  p  ;  • 


i :  i  ■  i  ;j  i  c M  rii]  i.ft1  dj  . »n ; 


,*  .  s  .  f o  r  " v  ’  n  t  p ryp  i  s 


'  S  Sri  id  to  !o 


n 


n 


for  x  •  A^  and  n  large  enough.  Thus  (3.5)  holds  and  i .  B  i.o.r  =  A(a,b)  a.s. 
Since  F(b-)-F(b-t  )  ■  0  for  any  ■  0,  .  ^  and  ^  may  be  chosen  arbitrarily 
close  to  b  and  therefore  1  i in  sup  X  =  b  for  almost  all  .  •  ,\(a,h). 

n->-o 

It  remains  to  consider  the  case  F(b-)  -  wnich  makes  b  u  point  of  type 
. Clearly  F(b)  '•  and  F(b)  -  F(b-)  >  0.  This  is  similar  to  the  case  of 
a  considered  before  and  may  be  dealt  with  by  taking  A^  !  =  (x :  F^  ( b)>k(b)+.-. } 
ix:k(b-)  -  l  <  (b-)  <  k(b-)  +  e}  or  =  lx:  F^n^(b)  >  k(b-)  +  2-  ■, 

•.  x :  k  ( b  - )  -  r  <  F^(b-)  <_  k(b-)  +  c)  according  as  b  is  of  type  1 1  -j  or  I, 

0  <  k(b-)-<:  <  k(b-)  +  2'  <  1  and  B  =  (b  -  ,  b  +  c  )  for  some  positive 

n  n  n  n 

with  1 i m  =  0  and  1 im  P(X  >B  )  =  F(b)  -  F(b-). 
n  n  n  v 

n-*-  -  n  -**> 

Consider  now  the  case  s^=a  and/or  s2=b.  Since  there  are  no  points  of 
type  I'  smaller  or  equal  to  a  and/or  larger  or  ^qua 1  to  b,  the  above  proof  may 
be  easily  modified  to  yield  lim  inf  X^  •  a  and/or  lim  sup  X  >  b  for  almost 

n-*'*  -  n  n  _ 

all  .  ■  A(a,b).  We  recall  that  the  Borel -Centel 1 i  lemma  makes  it  possible  that 

P ( X  -  x  i.o.)  1  0  for  a  sequence  fx  ’  with  lim  P{ X  =  x  )  -  0.  If  such  a 
r:  n  n  v  n  n 

n  -  ■ 

sequence  with  1 ir  x  ■  s,  exists,  then  a*  a,  and  similarly  if  such  a 

n  i 
n-- 

sequence  with  1  im  «.  s„  exists  then  b*  b  and  the  proof  is  finished, 
n  •  ’ 

'inder  sore  restrictions  cn  ,  Tneore.  •.  i.'u)  and  3.2(a,.  were  derivec 
i  r.  :  ?! .  If  F  is  the  uniform  distribution  on  [0,1',  Theorems  3 . 1  ( :  )  and 
■> .  ?  i  b )  ma  t  :>o  extracted  from  Proposition  (3.1;  s  '  L?!. 

Rcrvt.r  1.2.  Conditions  of  the  type  G  ( v ,  -  1  or  0  accordion  as  x  y 
■  y  .  were  considered  in  [7]  in  relation  tr  a.s.  convergence  ,i nd  proved 


2? 


Then  Theorem  9.5.2  of  [4]  applies  ana  yields 

PC {X  t  A  i.o.j  \  {X  -  B  i.o.)}  =  0.  Notice  that 
n  n  n  n 

CO 

(3.6)  P(U  -rX  «•  B  . }  j  X  =  x)  >  lim  P  ( { X  .  «■  B  . } !  X  =x) 

j=n+l  n  J  n  -  j-M,  J  J  '  n 

=  F<n)(a)  -  F[n)(a-) 

Taking  into  account  the  definition  of  (A^l  we  get 

F^(a)  -  F^(a-)  '•  k(a)  -  r-g  >  0  for  x  .  and  n  sufficiently  large,  which 

proves  (3.5)  for  A  =  k ( a ) - 1; - .  It  follows  that  lim  inf  X  =  a  for  almost  all 

n 

(j  >  .  ■  ( a  ,  b ) . 

We  prove  now  that  lim  sup  X  =  b  for  almost  all  u>  <  A(a,b).  Assume  first 

n— 

that  F(b-)  =  Qg  in  which  case  we  may  choose  ^  and  with  e,  :•  r?  >  0  such  that 
b  -  -  ,  and  b  -  are  continuity  points  of  F ,  ( b  -  <  ,  ,  b  -  :•  0 )  .  I  and 
F(b  -  i-  2 )  ‘  F(d  -  e.j)  '•  0.  Define  A^  =  { x :  k  ( b-f  ^ )  -  r  <  F^n\b  -  )  < 

k(b  -  ■,)  +  ■  ■  n  ;x:k(b  -  c^)  -  c  <  F^n'(b  -  <  k(b  -  ■  ^)  +  e'  where 

may  be  chosen  such  that  k(b  -  )  -e,  k(b  -  •  ,)  +  •  ,  k(b  ->  ?)  -  ■  and 

k(b  -  +  ■  •  (0,1)  and  k(b  -  -  k(b  -  ^ )  -  2>  '■  0.  Take  Bn  = 

(b  -  •  .j  ,  b4-^).  Then  again  we  get  lim  •  X^  .  A  ,■  -  A(a,b)  a.s.  and  we  snail 

show  that  (3.5)  obtains  in  this  case  as  well.  Indeed 

(3.7)  P(U  ■ X .  ■  3.X  -  x )  ■  1 i-  ?{  *  3  .  ■  X  -a ) 

j  =  n  + 1  ^  J  n  n  -  ■  !  n 


/ 
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Theorem  3.2.  Suppose  that  {X  }  is  a  SM  Markov  chain  converqinn  in 

- — —  n 

distribution  to  F.  Then  for  any  y  <  r  one  of  the  following  two  cases  occurs: 

(a)  y  is  of  type  I,  in  which  case  there  exist  some  numbers  iy  ■  and 

intervals  -r  I  n } ,  where  1^  is  either  (-«’,y  )  or  (-",yn],  such  that  lim  ■  1^- 

a.s.  exists  and  lim  P(X  -  I  )  =  F(y).  n 

(b)  y  is  of  type  II,  in  which  case  there  exist  an  interval  1  containinn 

y  with  end-points  a  and  b,  a  <  b  and  an  event  A(a,b)  with  P(A(a,b))  n  such 

that  lim  inf  X  =  a*  and  lim  sup  X  =  b*  for  almost  all  .  A(a,b)  and  some 
n  n 

n-*»  n-Hx> 

constants  a*  and  b*.  In  addition,  a*  <  a  or  :  a  according  as  a  =  s,  or  s-j  , 
and  b*  ->  b  or  =  b  according  as  b  =  s^  or  <  s~. 

Proof,  (a)  follows  from  Lemma  2.2(a).  It  is  clear  that  {y  }  may  not 

converge  to  y  if  the  set  {x:u  =  F(x)}  with  u  =  F(y)  has  more  than  one  point. 

To  prove  (b)  assume  first  that  a  >  s^  and  b  ■'  s?.  Set  for  definiteness 

I  =  [a,b)  where  a  and  b  are  finite.  The  case  I  =  (a,b)  is  simpler,  since  then 

a  may  be  treated  like  b  with  F(b-)  =  q?,  a  case  that  will  be  taken  up  further 

on.  Thus,  assume  a  to  be  to  of  type  II,  and  write  =  {x:  k(a)  -  t 

F^n\a)  •  k(a)  +  (}  n  {x:  F^(a-)  <  n}  where  0  <  k(a)  -  c  ••  k(a)  +  *  -'1 

and  0  <  r:  <•  k(a)  -  z.  Since  lim  F^(a)  =  k(a)  for  almost  all 

n-*»  n 

.  •  'lim  F^n^(a-)  ^  lim  P(W(a)  =  1  j  X  )  =  0-  we  get  that  lim  :X  .  A  *  =  A(a,b) 
n  -<  n  “  t\-->  n-«  n 

a.s.  Write  further  B  =  (a  -  ;  ,  a+>  )  where  ■  is  a  sequence  of  positive 

n  n  n  n  r 

nurbers  such  that  1  in'  ■  =  0  and  lim  P(X  •  B  )  =  F(a)  -  F(a-).  Vie  shall  show 

n  n  n 

n  n 

that  for  some  ■  with  0-  v  1  and  n  larqe  enouah 

• .  -V  P(U  X.  .  B.l'X  )  ■  for  almost  all  .  <  ■  X  .  A  • 

.  1  j  1  n  n  n 

uni  -  ° 
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lim  P(X  t  I^1)  =  F(y).  It  is  easy  to  see  that  F(x^)  <  F(y)  and  therefore 
n--  D  n 

0  0 

xn  <  yn  ^or  n  su^1' ciently  large,  which  together  with  stochastic  monotonicity 

yields  F^(y)  >  F^(y)  where  F^  =  lim  F^(y).  However,  F^\y)  -  zQ 

xn  yn  yn  x‘y^ 

J  n 


t n  \  ( r\ 

ar.d  lim  Fvr  (y)  •'  zn  is  contradicted.  Thus  lim  Fv  I;(y)  =  1  whenever 
0^0  x  J ' 

x  n--‘  n 

n 

lim  x^  =  x  <  Xg(y).  The  proof  for  x  >  x^(y)  may  be  derived  by  a  similar 
n-*»  J 

reasoning. 

Consider  now  the  case  when  y  is  of  type  II.  We  shall  prove  that 

lim  F^(y)  =  k(y)  for  any  (x  }  1  ■/ i t h  q  <  lim  r  (x  )  <  q0.  Suppose  that  the 
x  n  i  n  n  2 

n  n  1  n  >  - 

contrary  holds  and  take  for  definiteness  lim  F^(y)  <  k(y)  for  some  lx1} 

n-*°  xn 

such  that  q1  <  lim  )  =  q  <  q^ ■  By  stochastic  monotonicity  lim  F^  (y)  <  k (y ) 

n-**  n-*°  n 

wherever  x  '•  x',  and  since  (F^n^(y)}  converaes  a.s.  to  W (y)  as  n  we  aet 

xn 

P(W(y)  ^  k(y))  -  P(W(y)  =  0)  s  1 -q  >  l-q^,  which  is  impossible.  Since  the 
case  x  a  or  x  •  b  may  be  dealth  with  as  in  the  proof  given  above  for  y  of 
type  I,  it  remains  to  notice  that  k(y)  =  (F(y)  -q-|  )/P(A(a  ,b) )  follows  from 
the  more  cenerai  result  of  Theorem  2.1(b). 


Pomark  3.1.  If  y  is  of  type  II,  tnere  must  exist  at  least  two  points  x 

and  sentiences  *  ,  ;supp  .  r  with  lim  x  x  and  q,  •-  lim  F  (x  )  o„. 

n  n  i  n'  n'  2 

n  n-- 

.rdeed,  .  f  ( vl  •  c,„  Guarantees  (3.4)  for  some  sequences  x  •  supp  F  } 

2  n  n 

w:th  1  i  ’  rr.;  p)  in  each  of  (q]  ,F(y))  and  (f  (y)  ,q?)  . 

r .  »  t 

« r i 1 1 •  =  inf  •»;  x  supp  F  and  s^  ~  sup  -x:x  ■  supp  F  . 
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there  exists  a  subsequence  {xn  }  with  x  <  supp  F  and  lim  x  -  x  but  not  a 

k  nk  nk  k-*°  nk 

whole  sequence  { xn } ,  case  that  could  not  happen  if  x  c  supp  F.  In  what  follows 

we  shall  write  for  convenience  lim  x  =  x  wherever  x  r  U,  a  relation  that  should 

n 

n-K» 

oe  understood  to  be  replaced  by  lim  x  =  x  when  no  such  ! x  i  with  x  <  supp  F 

K  J  ,  n,  n  n  n 

k-»°  k 

exists,  the  arguments  used  in  the  proofs  being  the  same.  Write  x  (y)  = 
inf  (x:  F(x)  =  F(y ) }  and  x-j(y)  =  sup  {x:  F(x)  =  F ( y ) > . 

Theorem  3.1.  Suppose  that  { Xn }  is  a  SM  Markov  chain  converginn  in 
distribution  to  F.  Then 

(3.4)  lim  F$n)(y)  =  G(y) 

n-^'  n 

holds  for 

(a)  any  y  r,  x  •  1)  and  { xn }  t  T  supp  F  n  >  with  lim  xn  =  x,  except  maybe  for 

n~* 

x  -■  [xQ(y),  x^  (y)  ] ,  for  y  of  type  I  and 

(b)  any  y  .  T  • a , b • ,  x  •  U  and  '  x  >  •  supp  F  with  lim  x  =  x  such  that 

n  -■ 

lim  Fn(x  )  exists  and  differs  from  q^  and  q0 ,  for  y  of  type  II. 
n-*"'  c 

Proof.  Consider  first  the  case  when  y  is  of  type  I  and  assume  by  way  of 

contradiction  that  there  exist  xU  •  xA(v;  ana  zn  with  a  •  z^  •  1  such  that 

U  '  U  u 

1  i F^(y;  zr  for  a  sequence  ■  x^J !  witn  lim  -  x°  ana  >J  U .  We  mav 
0  0  n  n 

n  x  n  -■ 

n 

suppose  without  loss  of  generality  tnat  Zq  is  a  continuity  point  of  F  and  get 

as  in  the  proof  Proposition  Z.l(a)  that  if  1^  -  x:  F^n^(y)  ■  1  then 

1  i’  1  1^  -  W(  y )  -  1  -  a  .  s  .  ,  where  I  ^  is  either  (  -•  ,yu]  or  ( -  ■  ,y^)  and 

n  n  n  '  ■'n  Jn 

n  - 
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b  is  of  type  II  write  qj  =  P(W(b)  =  1)  and  q£  =  P(W(b)  >_  k(b))  and  notice 
that  F(b)  =  E(W(b) )  >  q2  >  E(W(y))  =  F(y)  requires  (q],q2)  t  (qj,q£)  which 
in  conjunction  with  Lemma  2.3(b)  leads  to  q2  =  q-j .  It  follows  that 
F(b-)  •'  q.j  •:  F(b)  which  makes  b  a  point  of  type  1 1  ^ .  On  the  other  hand, 

{W ( b)  =  k(b)}  f  (W(y)  =  k(y)l  a.s.  and  b  /  I  obtains  in  either  case. 

To  complete  the  proof  notice  that  by  Theorem  2.1(b)  A  =  (W(y)  =  k(y) } 

qrq2 

a.s.  for  any  y  with  q^  <  F(y)  <  q2>  i.e.  for  any  y  in  I. 

We  shall  next  introduce  two  types  of  limit  distributions  { ( y ) } 
corresponding  to  the  types  of  y  defined  above.  Let  r  =  { x :  0  <  F(x)  <  1}  n  C(F) 
where  C(F)  is  the  set  of  continuity  points  of  F.  Suppose  that  y  e  r  is  of  type 
I  and  define 

1  if  x  <  y 

(3.2)  G  (y)  =  ■ 

0  if  x  >  y 

Suppose  now  that  y  r  F  is  of  type  II.  Proposition  3.1  ensures  the 

existence  of  an  interval  I  with  end-points  a  and  b  such  that  A  = 

ql  ,q2 

(W(y)  =  k(y ) }  a.s.  for  any  y  c  I .  We  relabel  A  as  A(a,b)  and  define 

ql  ,q2 

1  if  x  <  a 

F(y)-q, 

(5.3)  Gx(y)  -  <  if  a  <  x  <  b 

0  if  x  >  b 

When  a  and/or  b  are  infinite,  (3.3)  undergoes  obvious  modifications. 

Let  U  =  { x :  x  =  1 i m  x  for  some  x  c  supp  F  }.  In  U  we  have  included 
k  n^  n^  n 

subsequences  ix  !  to  make  allowance  for  the  case  when  for  some  x  i  supp  F 
"k 


for  sequences  converging  in  distribution. 

Proposition  3.1.  Suppose  that  y  is  of  type  II.  Then  the  interval  I  is 
the  maximal  set  of  points  z  of  type  II  containing  y  such  that  (W(y)  =  k(y)}  = 

•  W  ( z )  =  k(z)>  a.s.  The  point  a  belongs  to  I  if  and  only  if  a  is  of  type  11^; 
a  and  b  are  of  type  I‘;  and  (a,b)  contains  only  points  of  type  lip. 

Proof.  We  show  first  that  (a,b)  does  not  contain  points  of  type  I! 

Assume  the  contrary,  that  y  e  (a,b)  is  of  type  I'.  Then  q  <  F(y-)  <  P(W(y)=l) 

F(y)  <  q?.  However,  by  Lemma  2.3(a)  W-  is  of  type  I  with  q  =  P(W(y)  =  1)  which 
z  q 

is  in  contradiction  with  Lemma  2.3  (b). 

We  prove  next  that  a  is  of  type  I'.  Let  P(W(y)  =  1)  =  F(a).  Since 
W(y)  may  take  at  most  three  distinct  values  with  positive  probability,  one  can 
choose  z  such  that  by  Proposition  2.1(a)  lim  {Xn<;In}  =  (W(y)  >  z)  =  (W(y)  =  1}  a 

n-Kc 

and  Lemma  2.2(b)  implies  that  a  is  of  type  I.  Notice  that  in  this  case  a  /  I 
by  the  way  a  was  defined,  which  agrees  with  the  statement  that  I  contains  only 
points  of  type  II.  If  q-j  <  F(a)  then  F(a-)  <_  q.|  =  P(W(y)  =  1 )  ■'  F(a).  Notice 
now  that  W(z)  is  a.s.  right-continuous  because  W(z)  is  monotone  in  z  and 
E(W(z  +  e)  -  W(z))  =  F(z  -r  c)  -  F(z)  -»  0  as  r  -*  0  is  due  to  the  right-continuity 
of  F.  Thus  either  y  =  a  or  y  >  a  and  taking  the  limit  of  P(W(y)  =  1)  as 
y  -  a  we  get  from  the  above  inequality  that  F(a-)  P(W(a)  =  1  )  •'  F(a),  proving 
that  a  is  of  type  1 1^ . 

We  prove  next  that  b  is  of  type  I'.  If  =  P(W(y)  ■  k(y))  =  F(b)  we  can 
argue  as  in  the  case  of  a  to  show  that  b  is  of  type  I.  If  q ^  '  F(b)  then  b 
may  be  of  type  I  or  II.  If  b  is  of  type  I  there  is  nothing  left  to  prove.  If 


16 


We  note  that  the  condition  assumed  in  Theorem  2.4  on  F*  and  F1'  is  always 
satisfied  if  F'  is  continuous. 

Corollary  2.2.  Suppose  that  { }  converges  weakly  and  contains  a 
subsequence  converging  in  probability.  Then  { Xn >  converges  in  probability. 

3.  Sequences  converging  in  distribution.  We  shall  now  assume  that  { 
converges  in  distribution  to  a  non-degenerate  limit  F.  Define 

(3.1)  F^n)(y)  =  lim  P(Xm  <  y | Xp  =  x) 

m-*» 

where  y  is  a  continuity  point  of  F  and  n  =  0,1 .  Theorem  2.1(a)  ensures 

the  existence  of  {F^(y)},  which  may  be  extended  to  right-continuous  functions 

A 

with  respect  to  y  by  defining  F^n^(y)  =  lim  F^^y')  for  any  jump  point  y  of  F. 

y'+y 

We  agree  to  write  W(y)  for  Wq  with  q  =  F (y )  and  define  y  to  be  of  type  I  or  II 
according  as  W(y)  is  of  type  I  or  II.  If  F  admits  jump  points,  there  must  be 
values  of  q  for  which  there  is  no  y  with  F(y)  =  q  even  if  W  may  be  well 

q 

defined,  since  q  =  lim  P(X  e  J  )  for  some  sequence  { n. }  and  left-unbounded 

n-xr.  nk  nk  K 

intervals  {J  }  is  a  possibility.  A  point  y  of  type  II  will  be  said  to  be  of 
nk 

type  11^  if  F(y-)  £  P(W(y)  =  1)  <  F(y),  and  of  type  II^  otherwise.  Points  of 
type  I  or  11^  will  be  said  to  be  of  type  I'. 

Assume  that  y  is  of  type  II  and  the  possible  values  of  W(y)  are  0,k(y) 

and  1.  Write  as  before  q^  =  P(W(y)  =  1)  and  q^  =  P(W(y)  =  1)  +  P(W(y)  =  k(y)) 

and  define  a  =  inf  { x :  x  <  supp  F,  F(x)  >  q^ ;  and  b  =  inf  (x:  x  .  supp  F, 

F(x)  >  $2*  ■  Let  I  be  (a,b)  or  [a,b)  according  as  F(a)  =  q^  or  '■  q^  .  Of  course, 
a  and/or  b  may  be  infinite.  The  next  result  characterizes  points  of  type  II 
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{ X  , }  and  (X  ,,}  under  the  assumption  that  { X  , }  converges  in  probability.  For 
nk  nk  nk 

a  weakly  convergent  sequence  { }  we  define  convergence  in  probability  to  a 

not  necessarily  finite  X  as  the  fulfilment  of  the  condition: 

lim  ?({X  <  x»  A  (X  _  x})  =  0  for  any  continuity  point  x  of  F  where  F  is 

n 

the  distribution  function  of  X. 


Theorem  2.4.  Suppose  that  {X  }  is  a  SM  Markov  chain  and  there  exists 
-  n 

a  subsequence  of  fX  },  say  {X  ,},  converging  in  probability  to  a  not  necessarily 

n  nk 

a.s.  finite  random  variable  X,  and  that  {X  is  another  subsequence  of 

nk 


{X^}, converging  weakly.  If  {y:  F*(x)  =  y,  x  c  C ( F ’ ) }  =  {y:  F‘'(x)  =  y,xeC(F'')} 

where  F'  and  F"  and  the  limit  distributions  of  {X  ,}  and  {X  ,,  },  and  C(F') 

k  "k 

and  C(F ' ' )  are  the  sets  of  their  continuity  points,  then  {X  „}  converges  in 

nk 


probabil ity. 


Proof.  Choose  x  to  be  a  continuity  point  of  F ' '  and  write  F '  '  ( x )  =  q. 

Then  there  must  be  a  continuity  point  of  F’,  say  x',  such  that  F'(x')  =  q. 

Since  { X  , }  was  supposed  to  be  convergent  in  probability,  it  contains  an 
nk 


a.s.  convergent  sequence,  so  that  we  can  assume  the  existence  of  1 i m  :X  , < x '  }  a.s. 

k  xr> 


In  view  of  Lemma  2.2(b)  this  makes  of  type  I.  Further,  by  Lemma  2.2(a)  there 

exists  a  sequence  of  left-unbounded  intervals  II  }  such  that 

n 

lim  IX  I  }  =  { W  =  1}  a.s.  with  lim  P(X  c  I  )  =  q.  It  follows  that 
„  n  n  q  „  n  n 

^  n-Kj° 


lim  P(rX  ,,  .  I  }  A  {X  <  x})  =  0  and  by  transitivity  lim  P(fX  ,,  <xl  A  fW  =1))=0. 
k-x«  nk  nk  rk  “  k  -  nk  ~  0 


An  appeal  to  Lemma  2  of  [1 J  yields  now  convergence  in  probability  for  fX  ,,  -  . 

nk 


where  x  is  a  continuity  point  of  F,  B  is  an  event  in  the  a-field  qenerated 

by  XQ, . . . ,X  and  m  an  arbitrary  non-negative  integer.  We  shall  consider  a 

generalization  of  (2.4)  to  Markov  chains  which  are  not  necessarily  convergent 

in  distribution:  { Xn }  will  be  said  to  be  mixing  if  for  any  q  r  (0,1)  for 

which  there  exist  a  subsequence  {n, }  and  left-unbounded  intervals  {J  '  such 

k  nk 

that  1 im  P(X  e  J  )  =  q,  then 
.  n.  n,  ^ 

k-*»  k  k 

(2.5)  lim  P(X  e  J  |X  )  =  q  a.s.  for  n  =  0,1,... 

k-*»  nk  V  n 

Theorem  2.3.  Suppose  that  { Xn }  is  a  SM  Markov  chain  and  there  exist 

q  e  (0,1),  some  numbers  { n.  >  and  left  unbounded  intervals  (J„  }  such  that 

"k 

lim  P(X„  c  |X„  )  =  q  a.s.  for  m  =  0,1,...  .  Then  {X  }  is  mixinq. 

"k  "k  "m 

Proof.  The  condition  stated  is  equivalent  to  =  q  a.s.  for  some  q 

q 

in  (0,1).  This  implies  q,  =  P(W.  =  1)  =  0  and  q9  =  1  -  P(W,  =  0)  =  1 .  By 

1  q  4  q 

Lemma  2.3(b)  there  are  no  points  of  type  I  in  (0,1),  i.e.  there  are  no  points 
of  type  I  at  all,  which  leads  to  P(Wq  =  0)  =  P(Wq  =  1 )  =  0  for  any  q.  It 
follows  that  Wq  =  q  a.s.  and  an  appeal  to  Theorem  2.1  yields  (2.5)  completing 
the  proof. 

Theorem  2.3  expresses  the  rather  surprising  property  that  mixing  is 
ensured  merely  if  (2.5)  holds  for  one  value  q  in  (0,1)  and  some  {n^t  and 


The  next  result  relates  properties  of  two  weakly  convergent  sequences 
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Proof.  By  Lemma  2.2(a)  for  any  f  >  0  there  exist  some  left-unbounded 

intervals  {J  (q  -  e)},  v J n ( q )  1  and  { Jn( q  +  c) }  such  that 

lim  {X  e  J  (q  -  t) }  =  (W  ~  li  a.s.,  1 im  (X  e  J  }  =  {W  =  1}  a.s.  and 
n-K»  n  ►°° 

li~  {X  L  J  (q  +  c)}  =  {W  =  11  a.s.  Since  for  n  large  enough 

n-Kx.  ^ 

J  (q  -  c)  c  ( -oo  x  ]  c  J  (q  +  e)»  it  follows  that  Ikl  =  1}  c 

nVM  '  v  nJ  nv^  q-e 

lim  inf  (X  <  x  }  =  lim  sup  {X  <  x  }  c  (IV  =1).  But  lim  P(W  =  1)  = 
n  —  n  —  „  K  n-n  q+e  n  q-e 

n-*»  n-*»  c-n) 

lim  P(W  =  1)  =  P(W  ),  concluding  the  proof. 
e->0  C|+e  q 

Theorem  2.2.  Suppose  that  { Xp>  is  a  SM  Markov  chain  and  that  {W^} 
exist  for  all  q  *v  (0,1)  and  are  of  type  I.  If  { f are  some  non-decreasing 
measurable  functions  such  that  {Yp},  with  Yn  =  f n( Xn) ,  converges  weakly,  then 
{Yn>  converges  a.s. 

Proof.  To  prove  a.s.  convergence  for  {Y^}  it  suffices  to  show  that 
lim  (Y  <_  x)  a.s.  exists  for  any  continuity  point  x  of  the  limit  distribution 

n-wo 

F  of  f Y n } ,  including  points  x  for  which  F(x)  =  1  or  F(x)  =  0,  Jwh i c h  may  be 

the  only  points  of  this  kind  when  F  is  degenerate).  Since  there  are  always 

points  {x  1  such  that  (Y  <  x}  =  {X  <  x  },  an  appeal  to  Lemma  2.5  finishes 
n  n—  n  —  n 

the  proof. 

The  next  result  refers  to  (W  1  of  type  II  for  which  P(W^  =  k  )  =  1.  Such 

q  q  q 

a  case  is  related  to  a  condition  of  mixing  given  by  Renyi  [23].  A  sequence 
f X^ }  converging  in  distribution  to  a  limit  F  is  said  to  be  mixing  in  the  sense 
of  Renyi  if 


lim  P(iXp  v  xl  -  B)  =  F(x)P(B) 
n 


(2.4) 
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P(W  =  k  )  >  0.  By  Lemma  2.3(a)  =  P(Wq  =  1)  and  =  l-P(Wq  =  0) .  It 

follows  that  E(W  )  =  q  =  q]  +  kqp(wq  =  kq)  =  Q1  +  kq( Q2-ql ^  *  This  ^ields 

kq  =  (q-q-,  )/(q2  -  q] )  and  Wq  =  1{W  =]}  +  (q  -  q-,  )/Cq2  -  q]  )  \  a.s. 


a .  s.  is 


q  1  ’ q  2 


now  easily  derived  from  the  remaining  statement  of  Lemma  2.3(a).  To  complete 

the  proof  notice  that  since  W  and  W  are  of  type  I,  Lemma  2.3(b)  makes  it 

^1  7 

impossible  for  (q^ .q^)  to  vary  with  q. 

Remark  2.1.  The  statement  about  the  existence  of  Gyn^(q)  in  Theorem 

n 

2.1  (a)  contains  as  particular  cases  Proposition  (3.1 )(j)  and  Remark  (3.2) 
of  [2]  removing  the  restriction  (1.1). 

Remark  2.2.  Although  we  defined  Wq  in  relation  to  a  subsequence  { n^}  for 

which  there  exist  intervals  {J  }  such  that  q  =  lim  P(X  e  J  ),  the  variables 

n,  .  n.  n, 

k  k-**>  k  k 

{Wq}  turned  out  to  be  independent  of  subsequence  choice.  If  Wq  is  of  type  I 
we  have  seen  that  there  must  exist  a  whole  sequence  { I  }  of  left-unbounded 
intervals  such  that  lim  P(Xn  c  In)  =  q  whereas  for  WQ  of  type  II  this  need  not 

n-K*> 

happen.  However,  if  condition  (1.1)  is  imposed  we  can  define  cqn^  to  be  the 

q-quantiles  of  X  and  get  that  lim  P(X  <  c^)  =  q  for  any  q  ?  (0,1)  so  that 

n  n-«°  n  ~  q 

in  tnis  case  Wq  exists  for  all  q  and,  besides,  there  is  no  need  to  confine 
ourselves  to  limits  of  subsequences  when  defining  (G^(q)l. 


Lemma  2.5.  Suppose  that  {Wq}  exist  for  all  q  <  (0,1)  and  are  of  type  I 

Then  lim  ;'X  x  }  =  f W  =1}  a.s.  for  any  (x  •  such  that  lim  F  (x  )  =  x. 
n  -  n  q  n  nv  n' 

r\-+-n  n  n-*- 


such  that  lim  P(X  c  J  )  =  q  for  some  sequence  {n. ;  and  left-unbounded 
k*  nk  nk  * 

intervals  {J  }.  Then 


(a)  There  exist  the  random  variables  G ^ ( q )  =  lim  P(X  r  J  IX  )  a.s. 

X„  n.  n, n' 


and  W  =  lim  Gyn^(q)  a.s.  for  n  =  0,1,...  where  E(W  |X  )  =  G^(q)  a.s.  for 

q  n  An 


■q  .  Xn 


n  -  0,1 , . . .  and  E(W^)  =  q. 

(b)  The  variables  W  are  of  two  possible  types:  I,  if  W  =1  a.s., 

q  q  tw  =  n 

and  II,  if  W  =  1  -  +  (q-q1  )/(q2-Q1 )  \  a.s.,  where  q 

{Wq1  "  1  '  ql,q2 

An  n  =  {W  =1}  \  (W  =  1},  0  <  q,  <  q  <  q?  <  1,  w  =  0  or  W  (of  type  I) 
ql,q2  q2  ql  “  1  qi  ql 

according  as  q,  =  0  or  >  0,  and  W  =  0  or  W  (of  type  I)  accordino  as  q  =1 

i  q2  q2  L 

or  <  1 .  The  quantities  q^  and  q^  do  not  depend  on  the  choice  of  q  in  (q^q^). 

Proof.  According  to  Lemma  2.1  Gyn^(q)  =  E(W  !X  )  a.s.,  which  in  view  of 

n  ^ 

Lemma  2.4  does  not  depend  on  the  choice  of  fn. }  and  {J  }  such  that 

k  nk 

lim  P(X  t  J  )  =  q.  Thus  any  subsequence  of  { P ( X  e  J  jX  ),  k  =  1,2,...} 

k-xo  nk  nk  nk  nk  n 

contains  a  further  subsequence  converging  to  G^(q).  It  follows  that  the  whole 

n 

subsequence  {P(X  e  Jn  |  ) ,  k  =  1,2,...}  converges  to  the  same  limit  G^(q). 

nk  nk  n 


The  remaining  statement  in  (a)  follows  from  Lemma  2.1. 

To  prove  (b)  recall  first  that  according  to  Proposition  2.1(b)  W  may 

take  at  most  three  distinct  values  with  positive  probability.  If  P(W^  =  1)  : 

1  -  P(W  =  0)  W  is  said  to  be  of  type  I,  in  which  case  it  is  obvious  that 
q  q 

W  =  lm  , ,  a.s.  with  E(W  )  =P  (W  =  1)  =  q,  whereas  in  the  case  when  W  is 
q  fw  -1}  q  q  q 

of  tvne  II  there  are  three  possible  values  for  W  :  0,k  and  1  with 

q  q 


an  i-atom  if  either  P(a)  =  0  or  P(a)  =  P(A)  for  any  a  such  that 

A  =  1 im  {X  r  L  }  a.s.  for  some  intervals  {L  1  with  Ln  <■  J  ,  n=0,l,... 
n-*«> 

Lemma  2.3  (b)  yields  the  following. 

Corollary  2.1  If  W  is  of  type  II  then  <  W  =  k  }  is  an  i-atom. 

- j — -  q  j  r  q  q 

The  sets  {W  =  k  }  will  turn  out  to  correspond  to  the  sets  •:.:!}  described 
q  q  i 

in  Fig.  1.1  for  the  sequences  f Xn }  convergent  in  distribution. 

Lemma  2.4  The  random  variables  {W  }  do  not  depend  on  the  choice  of  In.) 

q  K 

and  {J  }  such  that  lim  P(X  « J  )  =  q. 

k"^00  nk  nk 

Proof.  Choose  two  subsequences  {n^}  and  {n^}  such  that 

lim  P(X  f  J  )  =  lim  P(X  ,  t  J  ,1  =  q  for  some  left-unbounded  intervals  IJ  } 
k-<  nk  nk  k-K»  nk  nk  nk 

and  fJn,},  and  construct  the  limit  variables  and  VT  corresponding  to  the 

two  subsequences.  Assume  first  that  is  of  type  I.  Then  Lemma  2.2(a)  and  (b) 

may  be  invoked  to  show  that  is  also  of  type  I,  and  a  reasoning  may  be 

easily  extracted  from  the  proof  of  Lemma  2.2(b)  to  yield  that  {W^  =  1}  =  {VT  =  1 

This  is  equivalent  to  W  =  W'  a.s.  which  finishes  the  proof  in  case  I. 

q  q 

Assume  now  that  is  of  type  II.  Then  kT  is  also  of  type  II.  Recall 

the  notation  used  in  Lemma  2.3  and  write  q^  and  q^  for  the  quantities  attached 

to  Wq  and  q-j  and  q£  for  the  quantities  attached  to  W\  Since  q^  ■'  q  <  q^  and 

q ^  <  q  <  q£,  (q^.q^)  and  (q-j.q,))  may  either  partly  overlap  or  coincide.  Since 

W  ,  W  ,  W‘,,  W1,  are  of  type  I,  we  get  W1,  =  W  ,  and  W,  =  W  ,  by  the  proven 
ql  q2  ql  q2  ql  ql  q2  q2 

part  of  Lemma  2.4  and  an  inspection  of  Lemma  2.3  is  easily  seen  to  lead  to 

q-j  =  q.j  and  q^  =  q£,  completing  the  proof. 

Theorem  2.1.  Suppose  that  (X  i  is  a  SM  Markov  chain  and  choose  q  (0,1) 


.  •  -  -  ■  .•  ’.'^V  w  T?  »  "V  *7  -■»  -;v -wjr-  „  ■-■■*  '•'PJ  "W  "J"  "  "J  m  -  ■  wr 
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useful  in  deriving  some  properties  of  F  as  strict  monotonicity,  continuity, 
finiteness  of  moment,  etc.  (see  [8]). 

Remark  3.3.  If  all  y  T  are  of  type  I,  {X^}  may  not  converge  a.s.  By 

Theorem  2.2  convergence  a.s.  may  fail  if  not  all  {W^l  are  of  type  I. 

Such  a  situation  may  arise  if  F  admits  jump  points  resulting  from 

lumping  together  some  values  of  q  for  which  Wq  are  of  type  II.  Also  if  F 

has  intervals  on  which  it  is  constant.  Theorem  3.2(a)  cannot  be  invoked  to  get 

i im  {Xn  e  I  }  =  lim  (X^  ^  y}  a.s.  for  any  y  c  T  as  done  in  [7]  when  provina 

n->«>  n->o° 

a.s.  convergence.  The  minimal  condition  on  F  guaranteeing  a.s.  convergence 
seems  to  be: 

(b)  F  is  either  continuous  or  admits  jump  points  {c^,  i  e  0}  such  that 

(FU^  +  6)  -  F(ci-))(F(ci-)  -  F(ci  -  6))  >  0  for  any  6  >  0  and  i  »■  0.  This 

condition  was  considered  in  [7]  and  shown  to  entail  the  equivalence  of  a.s. 
convergence  and  convergence  in  probability. 

4.  The  stationary  transition  probability  case.  Assume  that  {Y^}  is  a  chain 
with  stationary  transition  probabilities,  ( an }  with  an  >  0  and  { b^ }  are  two 
sequences  of  constants  making  (an(Yn  +  b^)}  convergent  in  distribution  to  a 
non-degenerate  limit  F.  Write  Xn  =  an(Yn  +  b^)  for  n  =  0,1,...,  F^.(y)  = 

lim  P(Xn  x !  Yq  =  x)  where  y  is  a  continuity  point  of  F,  and  on(-)  -  P  ( Y  •  ) 

n->oc 

for  n  =  0,1,...  Further  v  <'■'  q  is  to  denote  that  v  is  absolutely  continuous 
with  respect  to  p. 

Lemma  4,1.  Suppose  that  <<  Vq.  Then  there  exist  two  constants  « 

and  8  such  that  lim  a  .,/a  =  »  and  lim  a  .,(b  ,.-b  )  =  8  with  0  "  and 

n+ in  n  + i  n+ i  n 

n-**> 

—QO  <f  ft  <  OO  # 


Proof.  Let  y  be  a  continuity  point  of  F  and 

(4.1)  P(Xn  <  y)  =  P(Xn  <  y|YQ  =  x)vQ(dx) 

The  dominated  convergence  theorem  applied  to  (4.1)  yields 

(4.2)  F(y)  =  lim  P(Xp  <  y)  =  |F  {y)vQ(dx) 

n-x»  > 

Using  the  stationarity  of  transition  probabilities  one  gets 

<4-3)  P(an(Yn+I  +  bn>  i  y)  =  |P(Vn+l  i  y/an  ‘  bJYl  =  x3v7(dx) 

=  fp(Xn  <  y|Y0  =  xjvjfdx) 

=  jp(xn  1  y)lYo  =  x)Avo(dx) 

where  X  =  dv^/dvg  stands  for  the  Radon-Nycodym  derivative  of  with  respect 
to  Vq.  The  dominated  convergence  theorem  applied  to  (4.3)  yields  the  existence 

of  F-j  (y)  =  lim  P(an(Yn+1  +  b  )  <  y)  and 

1  n-x=" 

(4.4)  F-j  ( y )  =  jFx(y)Xv0(dx) 

Since  Vg  (0  ^  X  <  °°)  =  1  one  may  easily  see  that  F^  is  not  degenerate.  Indeed, 
if  F^(y)  where  0  or  1  according  as  y  <  c  or  y  >  c  for  a  certain  constant  c, 
then  by  (4.4)  the  same  property  would  hold  for  Fx(y)  for  almost  all  x  with 
respect  to  Vq  and  by  (4.2)  F  would  be  degenerate  as  well.  Thus  both 
! a  (Y  +  b  ))  and  {a  (Y  ,,  +  b  )}  converge  in  distribution  to  non-deqenerate 
limits  and  the  result  now  follows  from  Khintchine's  theorem  on  convergence  of 


types  (see  e.g.  [22]  p.  2'6). 

Lemma  4.1  is  an  improvement  on  Theorem  3  of  [5]  where  a  stronqer  condition 
was  assumed  on  F.  We  notice  that  stochastic  monotonicity  was  not  used  in  the  proof 

Lemma  4.2.  Suppose  that  the  conditions  of  Lemma  4.1  are  satisfied  with 
a  f  1 .  Then  there  exist  some  constants  { }  such  that  (an(Yn  +  iy)}  converges 

in  distribution  to  a  non-degenerate  limit  and  lim  an+1(b^+^  -  b')  =0. 

n-*»  n 

Proof.  Take  b]  =  b„  -  An/a„  where  A„  =  6/(1  -  a).  Since  a  (Y  +  b')  = 

-  n  n  0  n  0  '  n  n  n 

Xn  -  Aq,  convergence  in  distribution  of  {aR( Yn  +  b^)}  to  a  non-degenerate  limit 
clearly  obtains.  Further  a^fb^,  -  b')  =  an+1(bp+1  -  bj  -  + 

and  taking  limits  gives  lim  an+1(b^+1  -  b ' )  =  6  -  AQ  +  aAg  =  0,  finishing  the 

n-*» 

proof. 

Remark  4.1.  Suppose  that  B  =  0  and  Xg  is  a  continuity  point  of  F.  Then 
anxQ  is  also  a  continuity  point  of  F  for  any  integer  n.  Indeed,  using  Lemma 
4.1  in  (4.4)  yields  F-j(x)  =  F(a  x)  and 

(4-5)  F(a( Xg  +  e ) )  -  F(a(Xg  -  e))  =  [(F^Xg  +  e)  -  Fx(xQ  -  e))AVg(dx) 

On  the  other  hand  (4.2)  implies 

(4.6)  F ( x g  +  c)  -  F ( x g  -  e)  =  j(Fx(x0  +  ~  Fx(x0  '  c))vQ(dx) 

and  it  is  clear  that  if  F  is  continuous  at  xr.  and  we  let  c  *  0  in  (4.6),  the 
integrand  must  tend  to  0  as  well  for  almost  all  x  with  respect  to  \-g,  i.e. 

Fx(-)  turns  out  to  be  continuous  at  Xg  for  almost  all  x  with  respect  to  Vg. 

By  (4.5)  this  implies  that  Xg  is  a  continuity  point  of  F  if  and  only  if  (Xg 


is  a  continuity  point  of  F  and  therefore  if  xn  is  a  continuity  point  of  F, 


so  will  be  a  Xq  for  any  integer  n. 

Similarly,  one  may  show  that  F(x2)  -  F(x^)  =  0  for  x2  >  x^  entails 
F(anx2)  -  F(anx-|)  =  0  for  any  integer  n. 

Let  G  be  the  shift  function  defined  on  G  by  0(uq,o)-|  , . . . )  =  , . . . ) 

and  write  0A  =  {0w:w  c  A),  G°A  =  A,  0_1A  =  {go :Ou>  c  A},  GkA  =  O(0k-1A)  and 

_  U  _  1  _  1/1.1 

0  A  =  0  (G  A)  for  k  =  1,2,...  .  If  J  is  an  interval  with  end-points 
x-j  and  x2>  OJ  is  to  denote  the  interval  obtained  from  J  by  reolacinn  x^  and 
x2  by  ax-j  and  ctx2  respectively. 

We  shall  further  need  the  follow'na. 

Lemma  4,3.  Suppose  that  v-|  ^  Vg  and  that  for  some  left-unbounded 

intervals  {J  }  lim  {Y  e  J  }  a.s.  exists.  Then  lim  {Y  e  J  }  a.s.  also  exists 
n  n  n  n+k  n 

n+oo  n-«” 


and  G  lim  {Y  e  J  }  =  lim  {Y  c  a.s. 


n  n 


n+k  1  n 


This  result  can  be  extracted  from  Theorem  5  of  [1]  and  Lemma  2  p.  91  of  [6]. 


Theorem  4.1.  Suppose  that  {Y  }  is  a  SM  Markov  chain  with  stationary 

transition  probabilities,  v,  <<  vn  and  {X  }  with  X  =  a  (Y  +  b  5  converaes  in 

l  u  n  n  n  n  n 

distribution  to  a  non-degenerate  limit  F  with  ot  f  1.  Then,  if  necessary  after 

a  recenterinq,  B  =  0  and 

(a)  there  exists  at  least  one  point  yg  of  type  I1 

(b)  if  yQ  f  0  is  of  type  I(II^)  then  anyg  is  also  of  type  I ( 1 1 , )  for  ail  n 

(c)  if  Yg  f  0  then  any  interval  J  of  points  of  type  II2  of  the  same  sign 
as  Yg  is  contained  in  an  interval  (anyg,  *n+^yg)  for  yg  >  0  (or  (>n+"*yg, 

,ny0)  for  yg  -  0)  for  some  integer  n.  If  J  is  an  interval  of  point  of  type 
II0  then  GnJ  is  also  an  interval  of  points  of  type  II9  for  all  n. 
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Proof.  Notice  that  by  Lemma  4.2  one  may  take  6  =  0.  Choose  y  to  be  a 
continuity  point  of  F.  Then  by  Remark  4.1  ay  is  also  a  continuity  point  of 
F  and 


(4.7) 


C  ’  P<Xmi^V0  =  *> 

0  m-K» 


"  ,im  P<am<vm+1  +  bm>  i*lvi  =  x> 


=  r[]\ay) 

X1 

where  Xg  =  ag(x  +  bg)  and  x^  =  a^(x  +  b^).  Assume  by  way  of  contradiction 

that  there  are  no  points  of  type  I1,  case  that  occurs  only  if  W(y)  is  a.s. 

constant  for  all  y.  Since  E(W(y)|X  )  =  F^(y)  a.s.  it  follows  that  Fy11^ 

n  Xn  Xn 

E(W(y) )  =  F(y)  a.s.  Using  this  in  (4.7)  for  n  =  0  and  1  gives  F(y)  =  F(ay). 
This  leads  to  F(y)  =  F(any)  for  all  n  and  if  y  >  0  one  gets  F(y)  =  1  whereas 
if  y  <  0  one  gets  F(y)  =  0.  But  such  F  is  degenerate  and  we  reached  a  contra¬ 
diction  that  proves  that  there  exists  at  least  one  point  yQ  of  type  I’  and 
(a)  is  proved. 

We  prove  (b)  for  yQ  of  type  I  (for  type  11^  the  proof  is  similar).  By 
Theorem  3.1(a)  there  exist  some  left-unbounded  intervals  { I  )  such  that 
T  =  lim  {X  e  I  }  a.s.  and  P(T)  =  F(yg).  Further  by  Lemma  4.3 

n-*jc 

OnT  =  lim  (X  ^  I  }  a.s.  exists  for  all  n,  where  X  ,  =  a  (Y  ,  +  b  ).  It 

m+n  m  ’  m+n  n'  m+n  n 

remains  to  prove  that  lim  P(X  .  e  I  )  =  F(anyn)  which  we  shall  confine 

m+n  m  U 

ITH00 

ourselves  to  prove  for  n  =  1.  By  (4.3)  and  (4.4)  we  get 


«  » 


(4.8)  | F(ax)  -  P(X 


m+1 


-  j 


;Fx(y) 


?(X  .  I  !¥„ 
m  m 1  0 


x) | Avq  (dx) 


But  F„  ^  y)  =  lim  P(X  c  I  IX  )  a.s.  for  all  n,  and  takino  n  -  0  we  net 
X  m  m  n 

n  m-*» 

lim  |F  (y)  -  P(X  «•  I  I Y  _  =  x )  |  =0  for  almost  all  x  with  respect  to  \n. 

1  x  m  tn '  0  0 

m 

Using  this  in  (4.8)  completes  the  proof  of  (b). 

To  prove  (c)  notice  that  there  is  no  interval  of  points  of  type  I I ^ 
straddling  (ctnyg,an+^yg)  for  some  n.  Indeed,  this  is  included  by  the  fact 
that  anyQ  and  un+  yg  are  of  type  I*.  Further,  if  J  is  an  interval  of  points 
of  type  1 1 2  ^  then  OnJ  must  also  be  an  interval  of  points  of  type  II?,  since  other¬ 
wise  if  y  were  of  type  I*  with  y  <r  Gnj  then  a'ny  c  J  and  by  (b)  a"ny  would  be  of 
type  I'.  This  contradiction  completes  the  proof. 

Corollary  4.1 

(a)  If  (-°°,0)  does  not  contain  any  point  of  type  I',  then  F(O-)  =  0 

(b)  If  (0,«)  does  not  contain  any  point  of  type  I',  then  F(0)  =  1. 


Proof,  (a)  and  (b)  being  symmetric,  it  will  suffice  to  prove  (a).  We 

show  first  that  J  =  (-°°,0)  is  the  maximal  interval  of  points  of  type  II^ 

containing  y  with  y  <  0.  Indeed,  according  to  Theorem  4.1  either  0  is  of  type 

I'  or  there  are  points  of  type  I'  in  (0,e)  for  any  c  >  0,  in  which  case 

Proposition  3.1  implies  that  0  is  of  type  I'  and  J  =  (-«,0).  It  follows  that 

q.|  =  0  and  F(y)  =  E(W(y))  =  k(y)q,>  for  y  •'  0.  Consider  now  the  sequence 

Zn  =  dn(Yn+i  +  t>n)  and  agree  to  attach  the  prime  to  the  symbols  for  { X n } 

when  referring  to  (Z  ).  We  claim  that  J1  =  (--,0).  Indeed,  since  the  limit 

distribution  of  fZ  )  is  F‘(x)  =  F(ax),  Theorem  4.1(b)  implies  that  (X  }  and 
n  n 

(Zn)  must  assume  the  same  points  of  type  I,  II,  and  II^.  Since  J  =  (-Y\0) 
we  get  J1  -  (-’,0)  as  well.  We  show  now  that  k 1 ( y )  =  k(y)  for  y  '  0.  Indeed, 
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by  the  stationarity  of  the  transition  probabil ities  of  (Y  }  we  qet  P(Z  *y  ''  l  =x) 

n  w  n —  m 

P(Xn  £  y I Xm  =  x)  for  n  >  m  and  recalling  the  definitions  of  (F^(y)], 

(F^n^(y)}  and  Theorem  3.1  we  get  k(y)  =  k‘(y)  for  y  <  0.  Recall  that 

either  of  iW  >  0}  or  {W  ,  0}  may  be  expressed  as  lim  (Y  c  J  1  a.s.  for 

q2  q2  n~*»  n  n 

some  intervals  (J  },  and  by  Lemma  2.3(a)  both  W  and  W1  are  of  type  I.  These 
n  g 2  ^2 

considerations  in  conjunction  with  Lemmas  2.2(b)  and  2.3(b)  boil  down  to 

=  q2.  It  follows  that  F’(y)  =  E(W‘(y))  =  k(y)q2  =  E(W(y))  =  F(y)  for 

y  <  0  which  is  incompatible  with  F'(x)  =  F(ax)  for  a  t  1  unless  F(O-)  =  0  and 

the  proof  is  finished. 

Remark  4.2.  An  interesting  consequence  of  Corollary  4.1  is  that  y^O  of 
type  I1  always  exists.  This  property  in  conjunction  with  Theorem  4.1  leads 
to  the  conclusion  that  0  is  also  a  point  of  type  I'.  Another  consequence  of 
Theorem  4.1  is  that  any  interval  (-e,e)  with  e  >  0  contains  all  the  information 
concerning  the  points  of  type  I,  1 1 ^  and  II2  of  the  real  line.  In  particular, 
if  lim  (X  _  x}  a.s.  exists  for  x  e  (-r.,0  then  {X  }  converges  a.s. 

n-H« 

Remark  4.3.  The  case  i=l,  may  be  treated  in  a  similar  way,  taking 

into  account  that  lim  (X  >  I  }  =  lim  iX  I  }  a.s.  where  I  is  obtained 

mm  m  m,n  m,n 

in-xr, 

from  I  by  replacing  y^  with  y^  +  np  (see  [6]).  Theorem  4.1(a)  carries  over 
without  changes.  For  Theorem  4.1(b)  and  (c),  the  requirement  y^  f  0  is  no 
lonqer  necessary  whereas  >tnyg,  tna  and  (nb  are  replaced  by  y^  +  n.-  < 
a  +  n.-  and  b  +  np,  respectively.  Corollary  4.1  may  also  be  extended  to  this 
case  on  using  a  similar  proof. 
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Theorem  4.2.  Suppose  that  { Y ( t ) :  t  t  [0 ,°°) >  is  a  right-continuous  Markov 
process  with  stationary  transition  probabilities,  a ( t )  and  b(t)  some  continuous, 
monotone  functions  with  lim  a(t)  =  0  or  «  such  that  X(t)=a(t)(Y(t)+b(t))  converoes 

t-»oo 

in  distribution  to  a  non-degenerate  limit  F.  Assume  that  v.  <<  v$,  where 

v  (•)  =  P(Y(t)  c  •)•  Then  lim  a(t+s)/a(t)=os  and  lim  a(t+s)(b(t+s)-b(t) )=£s 

t'^00 

for  some  constants  p  and  3  and  all  s  >  0.  In  addition,  one  of  the  followino  cases 
occurs : 

(a)  o=l  and  3=0.  If  in  addition,  lim  P(X(t)  <  x|Y(0)=y)  =  F(x)  for  all  x  and 

t-»°o 

y,  then  P(lim  inf  X(t)  £  s. )  =  P(lim  sup  X(t)  >  s^ )  =  1,  where  s^inf  supp  F  and 
S^  =  sun  SHOD  F. 

(b)  either  of  1  or  B  f  0,  in  which  case  there  exists  a  random  variable  W 

such  that  lim  X(t)  =  W  a.s.  In  addition,  supp  F  is  either  the  real  line  of 

t-*» 

one  of  its  half-lines,  and  F  is  strictly  increasing  on  its  support.  If  p  =  1 , 

F  is  continuous,  whereas  if  p  +  1  and  6=0,  F  is  continuous  except  may  be  for 
x  =  0. 

Proof.  We  shall  first  show  that  lim  a(t  +  s)/a(t)  =  oS  for  some  constant 

t-KD 

and  all  s  >  0.  To  this  aim  let  us  consider  the  skeleton  chain  {X(n6):n>0} 
for  a  certain  5  >  0.  According  to  Lemma  4.1  lim  a(  (n+1  )6)/a(n5)  =  t  ( 6 ) 

n-+<» 

exists.  Take  further  5'  =  6/k  for  a  positive  integer  k  and  write  '\{r. ')  = 

lim  a((n  +  1  )r '  )/a(nr* ).  But  a((n  +  l)5)/a(n-)  = 
n-f- 

a(  (n  +  l)<S)/a((n+  1)  -«S')a((n  -  1)  -<5')/a((n  +  1  )fi-2&  . .  .a(n,5+.S 1  )/a(n  • )  and 

1/ 

taking  n  we  get  <t(5)  =  a  (51).  Also,  it  is  easy  to  see  that  if  k'  is  a 
positive  integer  then  u(k'5')  =  (.S')  and  therefore  .(k'5/k)  =  ^(:). 

Thus  for  any  rational  number  r  >  0,  ar(<$)  =  ■ t(r -; )  •  Consider  further  an 


arbitrary  number  s  and  write  h(n6)  =  a(n(  +  s)/a(nA).  We  shall  show  that 
lim  h(n.t)  exists  for  all  A  •  0.  Indeed,  1  i m  h(n<S)  exists  for  6  =  s  as  shown 

n-xo-'  n-xo 

above.  Consider  now  s'  =  s/k  for  a  positive  integer  k  and  h'(nA)  =  a(nA  +  s')/a(nv). 

As  aoove  we  can  show  that  lim  h(ns)  =  (lim  h'(ns'))  .  Thus 

n-**  n-*00 

lim  h(ns)  =  lim  a(ns‘  +  s  )/a ( ns  ‘ )  =  lim  h(ns').  It  is  easy  to  see  that  we 

p-Kri  n-^°  n^°° 

can  replace  here  s'  by  a  multiple  of  s'  and  therefore  lim  h(n6)  exists  and  does 

n-K» 

not  depend  on  6  for  6  =  rs  where  r  is  any  rational  and  positive  number.  Choose 
now  =  r.j  s  and  ^  =  r^s  with  r^  and  r^  rational  such  that  0  <  <S,  <  6  <  62  < 

By  the  monotonicity  of  a ( t )  h(n6^)  <_  h(n5)  <  hfn^)  and  since  lim  h(nA^)=lim  t^nA^) 

n-**>  n-+°° 

one  gets  that  lim  h(n<S)  exists  for  all  6  >  0.  We  are  now  in  a  position  to  invoke 

n-«n 

a  result  by  Kingman  [18]  asserting  that  if  lim  h(n5)  exists  for  all  A  >  0  and  h  is  con 

n-w 

tinuous  then  lim  h(t)  also  exists.  We  have  already  proved  that.  nS(<$)=ct(sS)  for  s 
t-** 

rational.  It  is  easy  to  see  that  this  equality  extends  to  any  s  >  0,  and  takinq 

m(l)=3  we  get  lim  h(t)  =  qS.  A  similar  reasoning  yields  lim  a(t+s)(b(t+s)-b(t))  = 

t-*00  t-x» 

3s  where  £  =  lim  a(t  +  l)(b(t  +  1)  -  b(t)).  If  0  =  1  and  8  =  0 

t-K)C 

Theorem  2  of  [5]  makes  { X ( t ) }  mixing  and  (a)  follows  from  Theorem  3.2(b).  Assume 
now  that  0  >  1  and  B  =  0,  which  according  to  Lemma  4.2  may  be  achieved,  if 
necessary,  after  a  re-centering.  Since  by  Remark  4.2  any  skeleton  chain  tX(n  ):rr-j- 
assumes  at  least  one  yg/0  of  type  I',  we  deduce  that  all  points  of  -^(nr)}  must 

k 

be  of  type  I'.  Indeed,  by  Theorem  4.1(b)  i  y^  is  also  a  point  of  type  I'  for 
fX(n;)>.  If  we  choose  A'  with  -1  f  ^y^  for  all  k,  then  by  Theorem  3.1  •  X  ( t ) ,  t  ■  l ! ' 
where  U  =  ,  n r ;  ■  inf}  assumes  the  same  points  of  type  I’  as  (X(n-)  .  Since  '  is 
at  our  disposal  we  conclude  that  { X ( n f . )  assumes  only  points  of  type  1‘. 


rjrther.  accordinn  to  Remark  4.1 
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s  s 

F(x9)  -  F ( x-j )  >  0  implies  F(p  X2)  -  F(p  x^)  >  0  for  any  s,  which  makes  F 
strictly  increasing  on  it  support.  Remark  4.1  also  implies  that  if  x  f  0  is 
a  jump  point  for  F  then  pSx  is  also  a  jump  point  for  F,  and  s  being  arbitrary 
we  would  get  an  uncountable  set  of  jump  points,  which  is  impossible.  Thus, 
there  are  no  jump  points  for  F  except  may  be  for  x  =  0.  Since  F  is  continuous 
and  strictly  increasing  on  its  support,  an  argument  already  used  in  the  course 
of  the  proof  of  Lemma  2.5  yields  that  1 im  { X ( tn )  <  x'  a.s.  exists  for  any 

p-+oo 

continuity  point  x  of  F  and  this  is  tantamount  to  a.s.  convergence  for  {X(t  )}. 
Since  { X ( t ) }  was  assumed  right-continuous  we  conclude  that  (X(t)l  converges  a.s. 
(see  e.g.  [22]) 

The  case  p  =  1  and  6^0  may  be  treated  in  a  similar  way.  Since  {W=0} 
is  no  longer  invariant,  0  cannot  be  a  jump  point  for  F  in  this  case. 

5.  A  criterion  for  a.s.  convergence.  Theorem  4.1(b)  asserts  that  under 
some  conditions  on  p  and  R,  convergence  in  distribution  for  { X ( t ) >  entails  a.s. 
convergence.  In  many  cases  of  interest  it  is  rather  difficult  to  derive  con¬ 
vergence  in  distribution,  such  that  a  tractable  criterion  of  this  kind  seems  of 
interest.  We  shall  derive  nere  such  a  criterion  assuming  only  tightness  for 
■  X  ( t )  -  and  a  condition  on  the  transition  probability  functions  ■.  P  •  for 
s  ■  (0," )  and  some  f  '■  0 . 

A  random  process  ( t )  will  be  sain  to  be  tight  if  any  subsequence  thereof 
contains  another  subsequence  converging  in  distribution  to  <  non-identical  1 y 
0  random  variable. 

Further  we  shall  consider  the  following  conditions: 

(A)  Either  1  •  lip  inf  a(t  +  s)/a(t)  lim  sup  alt  ♦  s)/a(t)  ■  or 

t-  t- 

j  1  ip  inf  a(t  4  i)/a(t)  1  im  sup  a(t  4  s)/a(  •  )  1  for  soi  e  s  0. 

t -■  t- 
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(B)  There  exist  6  >  0  and  p  f  1  such  that 

1 im  P(|Y(t  +  s)/Y(t)  -  Ds1>e  |x(t)  f  0)  =  0 

for  any  c  >  0  and  s  e  (0,6). 

(Bl)  There  exist  6  >  0  and  p  f  1  such  that 

lim  P(Y(t  +  s)  e  (c(t)pS(l  -  e ) ,  c(t)ps(l  +e))|Y(t)=  c(t))  =  1 

t-x» 

for  c(t)  =  xa(t)  with  x  e  R,  e  >  0  and  s  s  (0,6).  The  main  result  of  this 
Section  is  the  following: 

Theorem  5.1.  Suppose  that  { Y ( t ) :  t  e  [0,“)}  is  a  non-negative  SM  Markov 
process  with  stationary  transition  probabilities,  X ( t )  =  a(t)Y(t),  where 
{ a ( t ) }  are  some  constants  that  satisfy  condition  (A).  Assume  further  that 
vt  <<  v$  for  t  >  s  where  v  (•)  =  P(Y(t)  e  •)•  Then  the  tightness  of  {X(t)l 
in  conjunction  with  condition  (Bl)  is  a  necessary  and  sufficient  condition  for 
the  existence  of  some  constants  { a ' ( t ) }  with  lim  a'(t  +  s)/a'(t)  =  cS  for 

t-HJO 

all  s  >  0  such  that  (a'(t)Y(t)}  converges  a.s.  as  t  ->  <»  to  a  non-degenerate 
random  variable  X.  If  F(x)  =  P(X  <  x)  then  supp  F  is  either  the  real  line  or 
one  of  its  half-lines,  F  is  continuous  except  may  be  for  x  =  0,  and  strictly 
increasing  on  supp  F. 

Remark  5,1 .  In  view  of  Theorem  4.1,  condition  (B)  is  necessary  for  a.s. 
convergence  when  b(t)  i  0.  It  may  be  shown  that  (B)  entails  (Bl)  if  X  ( t )  >  is 
tight  by  reasoning  in  the  manner  of  [8]  (see  also  [7]). 

In  what  follows  we  shall  assume  that  the  conditions  of  Theorem  5.1  are 
in  force.  We  shall  need  the  following  two  Lemmas: 
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Lemma  5.1.  Suppose  that  for  some  left-unbounded  intervals  { I ^  i 
1  im  { Y ( t )  .  I  }  a.s.  exists.  Then  for  any  real  s  0s  1  i in  T Y ( t )  .  I.1  - 

t-wr  t-*00 

lim  { Y ( t  +  s)  I.)  a.s.  also  exists. 
t-**°  z 

Lemma  5.2.  Suppose  that  { tn }  is  chosen  such  that  (X(t  )}  converges  in 
distribution  to  a  limit  F  as  t  -*■  Then  F  is  non-degenerate,  and  there  exists 
q  with  F(0)  <  q  <  1  such  that  is  of  type  I. 

We  delay  the  proofs  of  the  above  Lemmas  to  explain  now  the  idea  of  the 
nroof . 

Outline  of  the  proof  of  Theorem  5.1.  We  shall  confine  ourselves  to  the 
case  b(t)  =  0  and  Y(t)  >_  0.  By  Lemma  5.2  we  know  that  there  exists  x  such  that 
F(0)  <  P(W  j  x)  <  1.  Since  { Y ( t ) }  was  assumed  stochastically  monotone,  we 
deduce  that 

(5.1 )  ;W  >  x}  =  lim  { Y ( t )  r  I  } 

^  t-*00 

where  1^  is  either  (-•»',Xj.)  or  (-™,xt]  for  some  numbers  {x^}.  It  will  be  shown 

that  we  may  assume  that  1^  =  (-x,x^.J  such  that  (5.1)  and  Lemma  5.1  imply  that 

lim  f Y ( t  +  s)  '  x  }  a.s.  exists  for  all  s.  Since  condition  (Bl)  will  turn  out  to 
t  ~  '  z 

lead  to  lim  x  /x^.  ”  P  for  some  p  with  r/  1,  we  get 
t 

(5.2)  lim  { Y ( t  +  s)  <  x  1  =  lim  lY(t)  <  rSx  }  a.s. 

t  «■  t-*«  Z 

Ass  in  (5 . 2)  is  arbi trary ,  we  conclude  that  lim  ix’^Y(t)  <  xl  a.s.  exists 

t-vn  ^ 

for  all  x,  which  is  tantamount  to  a.s.  convergence  for  (x^Y(t)1. 
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Proof  of  Lemma  5.1.  This  lemma  is  a  continuous  time  variant  of  Lemma  4.3. 


Proof  of  Lemma  5.2.  We  shall  assume  that  1  <  lim  inf  a(t  +  s)/a(t) 

t-wc 

lim  sup  a(t  +  s)/a(t)  <  as  the  other  case  satisfying  condition  (A)  is 


reducible  to  this  one  by  taking  1 / V ( t )  instead  of  Y(t). 

Choose  x  to  be  a  continuity  point  of  F  and  let  F(x)  =  q.  Then 


(5.3)  P(a(tn)Y(tn  +  s)  <  x)  =  P(X(tn)  <  x|Y(0)  =  y)vs(dy) 


where  s  >  0.  Taking  the  limit  as  n  -*  «"  yields 


(5.4) 


F^S)  =  j  G^0)(q)vs(dy)  =  E(gJ°}) 


(s) 


where  '  is  the  limit  distribution  of  { a ( t  )Y(t  +  s)}  and 

n  n 

Gy^(q)  =  lim  P(X(tn)  <_  xjY(t)  =  y).  Assume  that  F  is  deoenerate.  Then 
J  n^ 


^(q)  -  0  or  1  a.s.  with  respect  to  Vq  and  \ s ,  since  «  Vq.  By  (5.4) 

F^(x)  =  F(x)  and  lim  inf  a(t  +  s)/a(t)  >  1  in  conjunction  with  the  tiontness 

t 

of  •; X ( t ) }  is  contradicted .  Thus  F  is  non-degenerate.  Suppose  now  that  W  is 
a.s.  constant,  i.e.  G^(q)  =  F(x)  a.s.  with  respect  to  Vq  and  and  as  above 
we  get  F^s'(x)  =  F(x)  for  any  s  >  0,  which  is  impossible.  Thus  W  is  not  a.s. 
constant  and  therefore  we  may  choose  a  point  z,  which  is  a  continuity  point  of 


the  distribution  function  oi7  W  ,  such  that  0  •  P(W  z) 


'hen  by  an  already 


familiar  argument  we  know  that  there  exist  some  left-unbounded  intervals  -rJ  • 

such  that  lim  (Y(t)  •  J.)  r  (W  >  z}  a.s.  and  if  P(W  >  z)  s  F(0),  Lemma  2.2 
t-o  1  G  ^ 


concludes  the  proof.  Assurrte  therefore  that  P^W  ■  z)  ■  F(0).  According  to 
Theorem  2.1  this  situation  corresponds  to  the  case  of  W  of  type  II  with 

q 
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'  ''  [/i  ^ 
Q 


1)  ■  Q  and  P(W  ~  1)  +  P(W  =  k  )  =  1.  Choose  z  >  k  .  Since  by  Lemma  5.1 
q  q  q  c  J 

1  r=  lim  { Y ( t  +  s)  •  J  }  a.s.,  if  we  take  into  account  the  assumption 
t  ~  1 


lim  inf  a(t  +  s)/a(t)  '  1  we  get  J^+s  =  for  t  large  enough  and  f-)b{W^  =  l  };y:  W^  =  i 


however,  we  know  from  [6]  that  P(W  -1  )-'l  entails  P  {  ‘  • 5 1  W  =  1 } )<1  .  Since  W  admits 

9  d  <1 

y  two  values  with  positive  probability.  Lemma  2.3(b)  makes  it  impossible  that 


?\  U  =1  ;  )'-P(W  =1 ) .  Thus  fw  =1}  is  an  invariant  set,  and  since  (W  =k  ■ 
q  q  q  q  q 

is  its  complementary  set  it  must  also  be  invariant.  Therefore  is  an  invariant 

random  variable.  It  follows  that  E(Gy^(q)  =  E(GyS/)  =  F(x)  and  (5.4)  implies 

(s)  s  s 

F  ( x )  =  P(x)  case  which  we  considered  before  and  turned  out  to  be  absurd. 


Proof  of  Theorem  5.1- Step  1.  We  first  show  that  if  A  =  lim  { Y  ( t )  J+  1  a.s. 

.  .  t-«r.  1 

where  F ( 0 )  <  lim  P(Y(t)  c  J.)  <  1  then  P(oSA)  >  P(A)  for  any  s  >  0.  The 
t  1 

existence  of  such  A  was  ensured  by  Lemma  5.2.  Recall  that  -  =  lim  inf  a(t+s ) / a ( t ) > 1 

t->* 

k 

and  obviously  lim  inf  a(t  +  k$)/a(t)  _>  r,  for  any  k  >  0.  Notice  further  that  if 
t  *■« 

xt  is  the  right  end-point  of  J^.,  then,  if  necessary  extracting  a  further 

subsequence  of  ft  1,  we  may  assume  that  a(t  )  cx^  where  c  is  a  positive 

n 

k  s 

constant.  The  above  argument  boils  down  to  P(o  a)  =  lim  P(Y(t  4  ks)  7  )  ' 

n n 

I  i,..  sup  PU(t  )  c  'o1')  =  F(c  *r,  ).  As  F  is  a  proper  distribution,  wo  .may  fine 
a--' 

-1  k 

r  large  enough  such  that  F(c  >  )  >  q.  Thus  there  is  a  k  such  that 
D(  5 a)  P ( A ' .  However  '  A  A  for  any  s  0  as  we  have  already  noticed  in 
trie  course  o-  the  proof  of  lemma  5.2.  This  mokes  Pi.  SA)  P ( A )  for  s  ‘  0  trie 
only  possibility  and  concludes  the  argument. 
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Step  2.  We  show  now  that  if  {s  }  is  a  sequence  of  positive  numbers  with 
s  n 

lim  sp  =  0  then  1 im  0  nA  =  A  a.s.  for  any  A  c  t>  where  j  is  the  tail  o-field 
n~*»  n-*» 

of  { Y ( t ) :  t  c  LO,00)).  Indeed,  { Y ( t ) }  was  assumed  to  be  right-continuous,  in 

which  case  it  is  known  that  F  =  lim  F.+s  (see  e.g.  [22])  where  F  is  the 

n-*»  sn 

s 

o-algebra  generated  by  { Y ( u ) :  0  <  u  <  t).  Since  P(0  nA|F  )  =  P ( A  j  F , )  for 

t+sn  t 

s 

t  >  0,  we  get  P(A'|F  )  =  P ( A | F t )  with  A'  =  lim  G  nA  on  letting  n-«°.  Because 

n-*» 

s  s 

0  A  is  decreasing  in  s  and  P  A  ^  A  for  s  >  0  we  conclude  that  A  =  A'  a.s. 

Step  3.  We  shall  next  show  that  { Y ( t ) / >  converges  a.s.  as  t-*«>  for  some 

constants  { x^} .  Indeed,  choose  q  e  (0,1)  such  that  F(xQ)  =  q  for  a  continuity 

point  xQ  of  F.  Then  W^  must  be  of  type  I.  Indeed,  assume  the  contrary.  Then 

by  Lemmas  5.2  and  2.3,  W^  must  assume  at  least  one  positive  value  out  of  P(W^  =  0) 

and  P(Wq  =1).  Assume  for  definiteness  that  P(Wq  =  0)  >  0.  Then  0  <  F(xQ)  <  P (Aq ) 

where  Aq  =  {W  >0}  =  lim  (X(tp)  c  }  a.s.  for  some  left-unbounded  {J.  ).  B.v 
1‘  q  n-><»  tn 

Steps  1  and  2  we  deduce  that  one  may  find  Aq  with  Aq  =  G_SAq  and  s  >  0  such 

that  F(xq)  <  P( A 1 )  <  P(A).  By  Lemma  5.1  we  know  that  A'  =  lim  (X(tp)eJ'  } 

n-K*1  n 

for  some  left-unbounded  intervals  {J.  }  and  according  to  Lemma  2.2(b)  W  ,, 

zn  q 

with  q'  =  P(Aq),  is  of  type  I,  which  contradicts  Lemma  2.3(b)  and  proves  that 

Wq  is  of  type  I.  Thus  Xq  is  a  point  of  type  I  and  therefore  there  exist  some 

left-unbounded  intervals  { I ^ >  with  right-end  points  {x^.1  such  that 

A  =  lim  { Y ( t )  e  Ij.)  a.s.  and  P(A)  =  F(Xq).  It  is  further  easy  to  see  that 

t-*» 

(5.5)  lim  P ( { Y ( t  )  e  I  }  A  { Y ( t  )  _  a(t  )xQ})  =  0 

n-^  n 


It  is  obvious  that  lim  { Y ( t )  e  If} 

n-KK' 


lim  { Y ( tn )  It  1  =  lim  {Y( t  +s ) 1 1 1  +$}  a.s. 

n-K»  Ln  n 


and  (5.5)  leads  to 


(5.6)  lim  P(  (Y(t  +s)d.  +s)  A  ( Y ( t  )  <  a(t  )x  })  =  0 


On  the  other  hand,  condition  (Bl)  implies 


(5.7) 


lim  p^a(tn)(xo  "  c)’  ^■°°«a(tn)xopS^  =  1 


(5.8) 


lim  Pjfa(t  )(xQ  +  e),  (-“,a(t  )xQp  ))  =  0 
n-x»  ~  ° 


Stochastic  monotonicity  applied  to  (5.7)  and  (5.8)  yields 

(5.9)  lim  Ps(x,(-oc,a(tn)xQpS))  =  1 

n-*»  !l 

uniformly  for  x  <  a(tn)(xQ-  c),  and 


(5.10) 


lim  Ps(x,(-»,a(tn)x0p:>))  =  0 

n-x» 


uniformly  for  x  >  a(tn)(xg  +  e) 


Taking  into  account  (5.9)  and  the  continuity  of  F  at  x^  we  get 


(5.11) 


F(xq)  =  lim 
n-x» 


Ps(x,(-»,  a(tn)xQp  )v  (dx) 

I  Ln 


(x  <  a ( t  X.)} 
—  n  u 


which  is  easily  seen  to  be  equivalent  to 


(5.12)  lim  P(Y(tp)  <  a(t  )xQ)  =  lim  P( { Y( tp  +  s)  <  a(tn)xQp  TnfY( tp)<a( tnxQ} ) 
n-»<»  n-x>- 


where  we  have  used  the  equality 


,X'a,tIV  v 


Ps(x,(-»,a(tn)x0ps)vt  (dx)  ■  P((V(tn  +  s)  <  a(tri)xor,s!  ,(v(tri)ca(tn)xon 
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Proceeding  in  the  same  way  as  above,  but  using  (5.1)  instead  of  (5.9)  we  aet 

(5.13)  lim  P(Y(t  )>a(t  )xQ)  =  lim  P({Y(tn  +  s)>a(tn)xQpS}n{Y(tn)>a(tn)x0}) 

It  is  now  easy  to  see  that  (5.6),  (5.12)  and  (5.13)  yield 

(5.14)  lim  P({Y(t  +  S)cl  +s)  A  (Y(tn+s)  <  a(tn)x0pS})  -  0 

n-*°°  n  1 

Because  Xq  was  chosen  to  be  an  arbitrary  continuity  point  of  F,  we  qet 

lim  xt  +  /xt  =p"S  and  since  {t  }  was  assumed  to  be  an  arbitrary  sequence  with 

n-x»  n  T'n  n 

lim  tn  =  00  such  that  (X(t  )}  converges  in  distribution  we  get  lim  x.+s/x  =  r*s 

n-«c  t-*» 

for  any  s  e  (0,6).  It  is  easy  to  see  that  the  latter  equality  implies 

lim  *t+s/xt  =  p~S  for  any  real  s.  Recall  that  lim  (Y(t+s)  e  I  }  a.s.  exists 

t-*°°  t"*30 

for  all  s  and  the  above  considerations  boil  down  to  the  existence  of 
s  s 

lim  { Y ( t )  ^  p  Xj.)  a.s.  But  p  may  take  any  value  as  s  is  at  our  disposal. 

t-KX> 

It  follows  that  ( Y ( t ) /x^. }  converges  a.s.  to  a  limit  X  as  t-*»,  and  X  was  shown 
to  be  non-degenerate  by  Lemma  5.2.  Since  Theorem  4.1  applies,  its  characteriza¬ 
tion  of  F  carries  over  to  this  case. 

Step  4.  To  prove  that  the  conditions  of  Theorem  5.1  are  necessary,  notice 
first  that  tightness  is  an  obvious  prerequisite  for  convergence  in  distribution. 
Condition  (Bl)  is  obviously  implied  by  the  a.s.  convergence  of  { Y ( t ) /x^ }  (as 
well  as  its  equivalent  form  (B))  if  we  take  r.  account  Theorem  4.1. 

6.  Appl ications.  Diffusions.  It  has  been  noticed  by  several  authors  that 
diffusions  are  SM.  Indeed,  the  birth-and-death  process  is  SM(see  e.g.  [17]). 

Since  by  a  result  of  Stone  [26]  any  diffusion  is  a  limit  of  birth-and-death  processes 


•••  LV  ■„  v  -.V.  -  ••  . 


«  «■■  r*  i;  i  ■  fip»  im 


T 
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it  follows  that  diffusions  are  SM.  Next  we  shall  give  an  a.s.  convergence 
criterion  for  Markov  processes  assuming  second  moments  that  may  be  applied  to 
diffusions.  We  need  consider  the  following. 

Condition  (B2).  There  exist  6  >  0  and  p  f  1  such  that 

lim  _ Var(X(t  4-  s)jX(t)  =  c(t)) _  =  Q 

t_>00  min2  [pSc(t ) (l+e)-E(X(t+s) |X(t)=c(t))],-[pSc(t)(l-c)-E(X(t+s)|X(t)=c(t))J^ 
for  c(t)  =  xa(t)  with  x  e  R,  e  >  0  and  s  e  (0,6) 

In  what  follows  we  shall  write  u(t)  ~  v(t)  whenever  lim  u(t)/v(t)=l. 

t-KO 

Theorem  6.1.  Suppose  that  { Y( t ) : t  e  [0,“)}  is  a  right-continuous  SM  Markov 

process  with  stationary  transition  probabilities,  v  «  for  t  >  s, 
t  2t 

E(X(t) )  ~  ap  and  Var  (X(t))  ~  bp  for  some  constants  a,b  and  p  with  b  >  0  and 
p  f  1,  and  that  Condition  (B2)  holds.  Then  {Y(t)/pt}  converges  a.s.  as  t  -*  °° 
to  a  random  variable  X.  If  F(x)  =  P(X  <  x)  then  supp  F  is  either  the  real  line 
or  one  of  its  half-lines,  F  is  continuous  except  may  be  for  x  =  0,  and  strictly 
increasing  on  supp  F. 

Proof.  We  shall  show  that  the  conditions  of  Theorem  5.1  are  verified. 

Indeed,  by  well-known  properties  for  sequences  of  distribution  functions  (see 
e.g.  [22])  any  subsequence  of  {X(t)/pt}  contains  another  subsequence  whose 
limit  distribution's  variance  equals  b  and  is  therefore  non-deoenerate.  Thus 
tightness  follows.  It  remains  to  show  that  (B2)  implies  (Bl).  Notice  that 

P(X  <■  (a  ,b) )  =  P(X  -  E ( X )  £  (a  -  E  (X) ,  b  -  E(X)) 


>  P( X  c  ( -c , c ) ) 
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where  c  =  min(b  -  E(X),  -(a  -  E(X)).  Specializing  X,  a  and  b  to  the  quantities 
that  appear  in  (Bl)  and  applying  the  Chebyshev's  inequality  we  get  that  (B2) 
implies  (Bl)  and  complete  the  proof.  Examples  of  diffusions  to  which  Theorem 
6.1  applies  include  the  Ornstein-Uhl enbeck  processes  (see  e.g.  L 1 6] )  and  some 
diffusion  processes  that  approximate  Galton-Watson  processes  (see  [11],  L13] 
and  [21]).  In  both  cases  E(Y(t)|Y(0)  =  x)  =  xeSt  and  Var  ( Y(  t) ) -be2^  with 
b  >  0  and  g  >  1.  Such  results  for  Ornstein-Uhl enbeck  processes  are  derived  by 
using  some  heavy  machinery  developed  for  diffusion  processes  (see  e.q.  [24]). 
For  branching  diffusions  some  analytic  tools  are  available  (see  [3]).  However, 
even  small  perturbations  in  the  transition  probability  functions  of  such 
processes  may  destroy  the  martingale  properties  on  which  their  study  is  based, 
whereas  the  conditions  of  Theorem  6.1,  being  of  the  limit  type,  seem  to  be  more 
robust  to  such  changes. 


Branching  processes.  We  shall  derive  a  limit  theorem  for  a  branching 
model  in  which  the  offspring  of  the  individuals  are  no  longer  independent, 
but  strictly  stationary.  Stochastic  monotonicity  methods  seem  to  allow  one  to 
establish  results  where  the  classical  proofs  based  on  independence  break  down. 


We  shall  pare  the  assumption  down  to  the  bare  essentials  so  that  our  conditions 
will  be  formulated  in  terms  of  properties  that  are  used  in  establishing  stochastic 
monotonicity  results.  We  shall  neither  bother  here  with  deriving  assumptions 
on  the  process  that  entail  such  conditions  nor  with  finding  minimal  conditions 
ensuring  our  results.  A  more  comprehensive  study  of  such  processes  will  be 
taken  up  elsewhere.  In  [7 J  we  studied  $M  branching  models  of  [3],  L13J  and  [25]. 


Suppose  that  (Z^:  t  .  [0,^)}  is  a  Markov  process  such  that 

lttt 

•  1*1:1 if  zt  -  °  •"<■  zt+u  =  ° if  zt  ■ 0 


(6.1) 


V"  .  ■  ■  .  *  4*  -  *  -  ■  T  •  ■  '  ■  v  :  -r .  -  •.  - — ^  ^  ■  ;rj  .  •  ■ 
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where  Z^’1  stands  for  the  number  of  offspring  at  time  t+u  of  the  i-th  of  the 
Zj.  individuals  alive  at  time  t. 

In  a  Galton-Watson  process,  (Z^’1}  are  assumed  i.i.d.  and  independent  of  Z 
Consider  next  the  following  conditions 

C(l)  The  sequence  (Z^;  i  =  1,2,...}  is  independent  of  Z^  and  is  distributed 
like  the  strictly  stationary  and  ergodic  process  {E;(u^;  i  =  1,2,...} 

C(2 )  P(lim  Z  =  oo)  =  i  _  p(l im  Z  =  0) 

t-Kn  t-*co 


C(3) 

(6.2) 


ihi  r\. 

-xx> 


For  any  (x  }  with  1 
u  u 

lim  P((zJ;J  >  x  }  u  (z‘;2 

I  I  '  7 


>  xu)  c  (0,1 )  one  gets 
>  x  J)  >  1 lm  P({zf;;  >  x  )) 

LI-KX5 


Theorem  6.2.  Suppose  that  { Zt }  is  a  right-continuous  process  that  satisfies 
conditions  C(l),  C(2)  and  C(3),  and  E(Zt)  <  Then  there  exist  some  norming 
constants  { c ( t ) }  with  lim  c(t+s)/c(t)  =  eaS  for  some  a.  >  1  such  that 

t-K» 


(Z(t)/c(t) }  converges  a.s.  to  a  random  variable  W.  If  F(x)  =  P(W  <  x),  then  F 
is  continuous  and  strictly  increasing  on  (0,“). 

x 


Proof 


.  Since  P  ( x , ( -°°,y] )  =  P(J  Z*’1  <  y)  we  can  easily  see  that 
u  x  *  u  — 


increasing  x  means  adding  more  non-negative  variables  to  the  sum,  which  of 
course  decreases  its  probability  of  being  smaller  or  equals  x.  Thus  { } 
is  SM.  Notice  now  that  (6.1)  and  C(l)  lead  to  E(Z^  )  =  E(Zt)E(Z  )  whereas 
C(l)  and  C(2)  yield  E(Z^)  >  1.  Thus  there  must  exist  a  >  1  such  that 
E(Zt)  =  eat  for  any  t  >  0. 

Birkoff's  ergodic  theorem  is  easily  seen  to  imply  (Bl)  and  also  (B)  in 


the  form 
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m 

& 


(6.3)  1 im  P(t!Zt+  /Zt  -  eaS;  >  e ! Zt  t  0)  =  0 

t-*-~° 

for  any  e  >  0.  If  we  define  a(t)  such  that  a_1(t)  is  the  y-quantile  of 

the  distribution  function  of  for  P(lim  1  -  0)  <  Y  <  ]  then  by  (6.3)  we 

t_>'jo 

conclude  that  1  <  lim  inf  a(t+s)/a(t)  <_  lim  sup  a(t+s)/a(t)  <  <*■-,  so  that 

t-*31 


condition  (A)  holds.  It  is  easy  to  see,  by  the  way  { a ( t ) }  were  defined,  that 

any  weakly  convergent  subsequence  of  {a ( t ) }  must  have  a  non-degenerate 

limit  distribution  F.  To  prove  tightness  for  {a(t)Z.}  we  need  to  show  that  F(^)=l. 

Assume  the  contrary  and  choose  {u  }  with  lim  u  =  °°  such  that  {a(t+u  )Z. ,  } 

n  „  n  n  t+u 

n-*«  n 

converges  in  distribution  to  F  and  {a(t+un)zjj^  )  converges  in  distribution  to 

n 

a  limit  G.  Notice  further  that  (6.1)  leads  to 


(6.4) 


V  Zt 


W  =  I  W  i 
i=l  1,1 


where  =  means 


that  W  and  V  W.  .  have  the  same  distribution,  whereas  W  is 
i=l  t’1 


distributed  according  to  F  and  (W.  .}  are  distributed  accordina  to  G.  Further 

L  ,  1 

(6.4)  leads  to 


(6.5) 


P(W  = 


°)  =  l  P(  u  W 

i  =  1  c  ’ 1 
n=l  J  1 


«)P(Zt  =  n) 


Since  {a ( t ) }  satisfies  condition  (A)  we  get  P(W  =  °°)  =  P(W^  •  =  '•-)  and  by 
C ( 3 )  the  right-hand  side  of  (6.5)  would  be  larger  than  its  left-hand  side, 
which  is  absurd.  Thus  P(W  =  «>)  =  0  and  the  condition  of  Theorem  5.1  are 
checked . 

As  we  mentioned  before,  the  conditions  of  Theorem  6.2  may  be  relaxed. 
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Perturbation  factors  may  be  allowed  in  (6.1)  whereas  some  kind  of  dependence 
for  {Z^}  on  Zt  in  the  manner  of  [19]  and  [20J  may  supercede  condition  C(l). 
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